
Calhoun 

iniutuiiaiul AKliiv« ou tfit Nilvdl Poi($ra{jua(« School 


Calhoun: The NPS Institutional Archive 
DSpace Repository 



Theses and Dissertations 


1. Thesis and Dissertation Collection, all items 


1999-03 

Predicting the proficiency of Arabic and 
Persian Linguists trained at the Defense 
Language Institute Foreign Language Center 

DeRamus, Nicole L. 

Monterey, California. Naval Postgraduate School 


http://hdl.handle.net/10945/13595 


Downloaded from NPS Archive: Calhoun 



DUDLEY 

KNOX 

LIBRARY 


http://www.nps.edu/ljbrary 


CsMwun is the Naval Postgraduate School's public access distal repository for 
research mate riels and tnstitutjiooal pubftcatiions created by the NPS community. 
Cathoufii is named for Professor of Mathematcs Guy K. CatHiuo, NPS's first 
appoinited — and publi^d — scholar^ author. 

Dudley Knox Library / Naval Postgraduate School 
411 Dyer Road / 1 University Circle 
MontereVr California USA 93943 



NAVAL POSTGRADUATE SCHOOL 
Monterey, California 



THESIS 


PREDICTING THE PROFICIENCY OF ARABIC AND 
PERSIAN LINGUISTS TRAINED AT THE DEFENSE 

LANGUAGE INSTITUTE FOREIGN LANGUAGE CENTER 


by 


Nicole L. DeRamus 


March 1999 

Thesis Advisor: 

Lyn R. Whitaker 

Co-Advisor: 

Samuel E. Buttrey 

Second Reader: 

John W. Thain 


Approved for public release; distribution is unlimited. 


1 9 9904150 lO 



REPORT DOCUMENTATION PAGE 

Form Approved 

OMB No. 0704-0188 

Public reporting burden for this collection of information Is estimated to average 1 hour per response, including the time for reviewing instruction, 
searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send 
comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to 
Washington headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 
22202-4302, and to the Office of Management and Budget, Paperwork Reduction Project (0704-0188) Washington DC 20503. 

1. AGENCY USE ONLY fLeave d/aniy 2. REPORT DATE 3. REPORT TYPE AND DATES COVERED 

March 1999 Master’s Thesis 

4. TITLE AND SUBTITLE 

PREDICTING THE PROHCIENCY OF ARABIC AND PERSIAN LINGUISTS TRAINED AT 
THE DEFENSE LANGUAGE INSTITUTE FOREIGN LANGUAGE CENTER 

5. FUNDING NUMBERS 

6. AUTHOR(S) 

DeRamus, Nicole L. 

7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) 

Naval Postgraduate School 

Monterey, CA 93943-5000 

8. PERFORMING 

ORGANIZATION REPORT 
NUMBER 

9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 

10. SPONSORING/ 

MONITORING 

AGENCY REPORT NUMBER 

11. SUPPLEMENTARY NOTES 

The views expressed in this thesis are those of the author and do not reflect the official policy or position of the Department of 
Defense or the U.S. Government. 

12a. DISTRIBUTION/AVAILABILITY STATEMENT * 

Approved for public release; distribution is unlimited. 

12b. DISTRIBUTION CODE 

13. ABSTKPJZT (maximum 200 words) 

The mission of the Defense Language Institute Foreign Language Center (DLIFLC) is to train, sustain, and evaluate foreign 
language skills of linguists under the guidelines of the Defense Foreign Language Program (DFLP). The DFLP provides the 
Department of Defense and other Federal agencies with linguists capable of supporting LFnited States national interests worldwide. 

The DLIFLC is responsible for the language training of enlisted and officer personnel of the four armed services and a small 
number of federal civilians. 

Program tests and semester grade point averages (GPAs) evaluate progress within any DLIFLC language program. Satisfactory 
progress is defined as maintaining at least a C— average in course work. Student success is realized in the student’s attainment of 
minimum proficiency requirements in listening, reading, and speaking skills on the Defense Language Proficiency Test (DLPT). 

The purpose of this study is to determine how major program tests, semester GPAs, and cumulative skills GPAs in the Arabic and 
Persian language departments relate to success on the DLPT. The results of this study will assist the school deans within these 
language departments in interpreting the meaning of program tests, semester GPAs, and cumulative skills GPAs when making 
decisions about attrition and academic performance. 

The results indicate that the semester GPAs are the most predictive variables of overall DLPT performance for both Arabic and 
Persian lansuases. 

14. SUBJECT TERMS 

Language Training, Defense Language Proficiency Test, Program Tests, Semester GPAs, Cumulative Skills 
GPAs 

15. NUMBER OF 
PAGES 

146 

16. PRICE CODE 

17. SECURITY CLASSIFICATION OF 
REPORT 

Unclassified 

18. SECURITY CLASSIFICATION OF 
THIS PAGE 

Unclassified 

19. SECURITY CLASSIFI-CATION 

OF ABSTRACT 

Unclassified 

20. LIMITATION 

OF ABSTRACT 

UL 


NSN 7540-01-280-5500 Standard Form 298 (Rev. 2-89) 


Prescribed by ANSI Std. 239-18 


1 



























THIS PAGE INTENTIONALLY LEFT BLANK 



Approved for public release; distribution is unlimited 


PREDICTING THE PROFICIENCY OF ARABIC AND PERSIAN LINGUISTS 
TRAINED AT THE DEFENSE LANGUAGE INSTITUTE FOREIGN LANGUAGE 

CENTER 


Nicole L. DeRamus 
Lieutenant, United States Navy 
Auburn University, 1993 

Submitted in partial fulfillment of the 
requirements for the degree of 


MASTER OF SCIENCE IN OPERATIONS RESEARCH 


from the 


NAVAL POSTGRADUATE SCHOOL 
March 1999 



Richard E. Rosenthal, Chairman 
Department of Operations Research 











THIS PAGE INTENTIONALLY LEFT BLANK 


IV 




ABSTRACT 


The mission of the Defense Language Institute Foreign Language Center (DLIFLC) is to 
train, sustain, and evaluate foreign language skills of linguists under the guidelines of the 
Defense Foreign Language Program (DFLP). The DFLP provides the Department of Defense 
and other Federal agencies with linguists capable of supporting United States national interests 
worldwide. The DLIFLC is responsible for the language training of enlisted and officer 
personnel of the four armed services and a small number of federal civilians. 

Program tests and semester grade point averages (GPAs) evaluate progress within any 
DLIFLC language progreun. Satisfactory progress is defined as maintaining at least a C- average 
in course work. Student success is realized in the student’s attainment of minimum proficiency 
requirements in listening, reading, and speaking skills on the Defense Language Proficiency Test 
(DLPT). 

The purpose of this study is to determine how major program tests, semester GPAs, and 
cumulative skills GPAs in the Arabic and Persian language departments relate to success on the 
DLPT. The results of this study will assist the school deans within these language departments in 
interpreting the meaning of program tests, semester GPAs, and cumulative skills GPAs when 
making decisions about attrition and academic performance. 

The results indicate that the semester GPAs are the most predictive variables of overall 
DLPT performance for both Arabic and Persian languages. 
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EXECUTIVE SUMMARY 


The Defense Language Institute Foreign Language Center (DLBFLC) is responsible for 
the language training of enlisted and officer personnel of the four armed services and a small 
number of federal civilians. Program tests and semester grade point averages (GPAs) evaluate 
satisfactory progress within any DLIFLC language program. Student success is realized in the 
evaluation of student proficiency in listening, reading, and speaking skills on the Defense 
Language Proficiency Test (DLPT). Completion of the DLPT is a graduation requirement for all 
students enrolled in any of the twenty-one language programs at DLIFLC. 

The purpose of this study is to determine how major program tests, semester grade point 
averages, and cumulative skills GPAs in the Arabic and Persian language departments relate to 
success on the DLPT. These two particular languages are studied at the request of the Arabic 
and Persian deans. The results of this study will assist the deans managing these language 
departments in interpreting the meaning of program tests, semester GPAs, and cumulative skills 
GPAs when making decisions about attrition and academic performance. 

The focus of this thesis is threefold. First, we seek to determine if major program tests, 
cumulative skills GPAs, or semester GPAs are predictive of DLPT performance in the Arabic 
and Persian language programs by determining the relationship between each major program test 
grade or semester GPA and the DLPT in listening, reading, and speaking. The relationship of 
cumulative skill semester GPAs to the DLPT is also explored. Secondly, we concentrate our 
attention on sustained student performance across all three semesters and predictors of 
performance from test to test and semester to semester through the relationships among each of 
the major program tests, semester GPAs, and cumulative skills GPAs. Finally, we determine if 
individual program tests could be identified as having a strong relationship to DLPT performance 
to aid the language programs in recycling or dropping students. 
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The major program tests, known as “phase tests” in Persian and “C-Tests” in Arabic, are 
useful predictors of DLPT performance in the skills of listening, reading, and speaking because 
the major program tests independently assess these three skills as well. In addition, tests taken 
towards the latter half of the curriculum tend to be more predictive of DLPT performance than 
those of the first half. Stepwise regression and regression trees are used to create the models. In 
the Persian analysis, the last two phase tests are selected as the most predictive in all three skills. 
However, the first two phase tests appear in the models as well. In the Arabic analysis, the 
following C-Tests appear in the models: eleven, twelve, fourteen, fifteen, and semester tests two 
and three. C-Test eleven appears in the majority of the models, and semester tests two and three 
appear in half of the models, each. Very few tests taken earlier in the course appear in the 
models. 

Our initial belief is that the cumulative skills GPAs are the best overall predictors of 
Arabic DLPT performance. From the classification tree analysis, we find the cumulative skills 
GPAs prove themselves to be valuable tools in forecasting DLPT performance in listening, 
reading, and speaking. The GPA intervals provide the Arabic language program with an 
objective, versus subjective, instrument to predict DLPT performance. Interestingly, the 
cumulative skills GPAs are not identified as the best overall predictors of DLPT performance. 

Instead, we find semester GPAs to be the best overall predictors. We are interested in 
how well semester GPAs can predict DLPT performance. Classification trees and continuation 
ratio models are used. Because the semester GPA includes a variety of different grades and areas 
of study not strictly limited to the assessment of the three skill areas, we believe that the semester 
GPA would not be as useful as the program tests or cumulative skills GPAs. However, the 
analysis shows the value of the semester GPAs. For Persian, semester GPAs one and two are 
good indicators, and for Arabic, semester GPAs two and three are good indicators of DLPT 
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performance. Semester GPAs are identified as being the best overall predictors of DLPT 
performance for both Persian and Arabic. 

In trying to predict performance on a future test or GPA based on previous test or GPA 
performance, we find inconsistent results. For Persian phase tests, the analysis provides little 
evidence that we can predict future achievement based on past achievement. However, for 
Arabic, there appears to be some credence to this. The inconsistency could be because the 
Arabic C-Tests were designed and carefully orchestrated to address a content and skill 
progression in their tests. Although Persian phase tests relate to the course content and a skill 
progression, they appear to do so to a lesser extent than Arabic. For both the Persian and Arabic, 
we find previous semester GPAs and cumulative skills semester GPAs to be predictive of future 
GPAs. These results are supported by the very high correlations between the GPAs. 

This study shows that major program tests, semester GPAs, and cumulative skills GPAs 
are all useful tools in predicting DLPT success. I recommend that DLFLC use the results and 
models to predict student performance in the Arabic and Persian language programs. Each of the 
models presented can also be used in similar analysis for other DLIFLC language programs. 
However, these models are only as reliable as their inputs. To increase the reliability of these 
models, I reconunend that DLIFLC review the program tests for content and the testing of skill 
progression. This will ensure students are being exposed to questions specifically related to 
course material, but more importantly to questions that will increasingly assess their proficiency 
within the language and the three skills with each successive test. I also recommend that 
complete student records, including semester GPAs, program test raw scores, and cumulative 
skills GPAs, be retained for a period of at least two years to facilitate further analysis. 
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I. INTRODUCTION 


The Defense Language Institute Foreign Language Center (DLIFLC) is located at the 
United States Army Presidio of Monterey, California. It is responsible for the language training 
of enlisted and officer personnel of the four armed services and a small number of federal 
civilians. Satisfactory progress within any language program is defined as maintaining at least a 
G- average in course work as evaluated by program tests and semester grade point averages 
(GPAs). Student success is realized in the evaluation of student proficiency in listening, reading, 
and speaking skills on the Defense Language Proficiency Test (DLPT). The purpose of this 
study is to determine how major program tests, semester GPAs, and cumulative skills GPAs in 
the Arabic and Persian language departments relate to success on the DLPT. These two 
particular languages are studied at the request of the Arabic and Persian deans. The results of this 
study, will assist the deans managing these language departments in interpreting the meaning of 
program tests, semester GPAs, and cumulative skills GPAs when making decisions about 
attrition and academic performance. 

A. BACKGROUND 

1. History of DLI and its Purpose 

The mission of the DLIFLC is to train, sustain, and evaluate foreign language skills of 
linguists under the guidelines of the Defense Foreign Language Program (DFLP). The DFLP 
provides the Department of Defense and other Federal agencies with linguists capable of 
supporting United States national interests worldwide. In accomplishing its three primary 
mission areas, DLIFLC ensures that our military forces are prepared to meet global foreign 
language requirements. (DLIFLC General Catalog, 1996) 
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Training consists of basic, intermediate, advanced, and specialized programs. There are 
21 languages taught at DLIFLC Monterey with a total capacity of 3000 students per year. Eighty 
percent of students receiving training at DLIFLC also receive post-graduation training at 
Goodfellow Air Force Base, Texas or Fort Huachucha, Arizona. The student population is 
comprised of 70% Cryptologic Training System students, 21% General Intelligence Training 
System, and 9% Astronauts, Federal Agency students, and International students. (Payne, 1993) 

DLIFLC curricula are designed to develop the language skills and knowledge service 
members will need at their final field assignments. The bases for the curricula are the Final 
Learning Objectives (FLOs). The National Security Agency and Defense Intelligence Agency, in 
coordination with the four military services, set the standards for the vast majority of students in 
the Defense Foreign Language Program. DLIFLC combined the requirements from both 
communities into a single set of program objectives for all students known as the FLOs (DLIFLC 
General Catalog, 1996). 

2. DLI Tests 

DLIFLC uses four testing tools to assess student aptitude and performance. These tests 
are (1) the Defense Language Aptitude Battery (DLAB), administered prior to DLIF1.C training; 
(2) the “major program tests” administered periodically throughout a DLFLC basic course; (3) 
the Performance FLO tests, administered at the end of DLIFLC training; and (4) the Defense 
Language Proficiency Test (DLPT), also administered at the end of DLIFLC training. The DLAB 
is used by all of the Services as a screening device for identifying individuals who have the 
potential to study a foreign language under the DFLP. It has been shown that the higher the 
DLAB score, the better the chances for success in the course (Lett & O’Mara, 1990). The major 
program tests are developed within the respective language departments, by teaching teams or 
individual instructors, in order to evaluate student progress in course work. Specific linguist job 
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skills such as translation and transcription are tested by the Performance FLO tests. These tests 
were developed by DLI to be used with the DLPT to evaluate whether or not graduating students 
have met the training objectives (DLIFLC, 1995). Proficiency FLOs, which encompass the 
traditional language skills of listening, reading, and speaking, are tested by the DLPT. This 
research will focus exclusively on major program tests and the DLPT, specifically in the Arabic 
and Persian language programs. 

A major program test is a test developed by a particular language department given to all 
students enrolled in that language department at predetermined testing intervals to assess student 
progress in course work. Arabic has 18 major program tests administered over the course of 63 
weeks and Persian has six tests administered over the course of 47 weeks. These tests 
individually appraise the listening, reading, and speaking skills of the students. 

Program tests are developed in the language schools and not by the centralized DLIFLC 
Test Development Division. Program tests are not routinely evaluated for their validity and 
reliability in the manner that the DLPT and Performance FLO tests developed by the DLIFLC 
Test Development Division are. However, performance on these major program tests determines 
whether or not an individual is succeeding in assigned course work. A minimum grade of C- 
must be maintained in all course work to remain in the language program. If an individual fails 
to maintain a C- in course work for a period of four consecutive weeks, he or she may be 
recycled to a point earlier in the course or removed from the class altogether. Thus, performance 
on the major program tests is key to the success of the student. The major program speaking test 
is an oral response test administered md graded at the target language school by a speaker of the 
target language. For Arabic, major program reading and listening tests are constructed-response 
tests except for semester tests, which are multiple-choice. For Persian Farsi, major program 
reading and listening tests are multiple-choice. 
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The DLPT has been used since 1958 to evaluate military personnel’s acquired or 
maintained language proficiency in listening, reading, and speaking. DLPT listening and reading 
tests are multiple-choice tests graded by computer. DLPT speaking tests are oral response tests 
administered and graded under the auspices of the DLIFLC Proficiency Tester Education 
Division by certified testers. Military personnel continue to take the DLPT listening and reading 
tests throughout their careers. The results of the DLPT are used to award incentive pay for those 
in billets requiring language skills to ensure they remain proficient. 

The DLPT is designed to assess how well individuals can use their foreign language 
functionally, regardless of how they acquired their language proficiency. The DLPT is 
developed by the Test Development Division of the Directorate of Evaluation and 
Standardization, DLIFLC. It has been shown to be both reliable and valid, and has been 
endorsed by the American Council on Education (ACE) as an acceptable basis for the awarding 
of college or university credits (Payne, 1996). 

Completion of the DLPT is a graduation requirement for all students enrolled in one of 
the twenty-one language programs at DLIFLC. Department of Defense (DoD) DLPT proficiency 
standards, also known as Interagency Language Roundtable (ILR) Descriptions, are outlined in 
Table 1.1. The level of proficiency is assigned based on a “base level” of 0,1, 2, or 3. Each level 
also has an associated “plus level.” The “plus level” designation is assigned when proficiency 
exceeds one base skill level but does not fully meet the criteria for the next base level. (DLPT IV 
Familiarization Guide, 1991) 

DLIFTLC’s training goal is to have at least 80 percent of graduates in all basic courses 
meeting Level 2 in listening, reading, and speaking on the DLPT. Level 2 students exhibit 
sufficient comprehension to understand conversations and to meet routine social demands and 
limited job requirements, and they possess sufficient comprehension to read simple, authentically 
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written material. Level 1 students possess elementary proficiency in areas of immediate need or 
on very familiar topics. 

Instead of being defined in terms of individual skills scores, success on the DLPT is 
sometimes defined in terms of attaining a “ 2/2/1 or higher” or a “2/2/2 or higher.” A 2/2/1 
indicates that a student has attained a proficiency level of 2 in both listening and reading skills 
and a proficiency level of 1 in speaking for his or her language. A 2/2/2 indicates that a student 
has attained a level 2 in all three skills. To be eligible for follow-on training, enlisted personnel 
must attain a 2/2/1 for training at Goodfellow AFB or a 2/2/2 for training at Fort Huachucha, 
Arizona. 


Table LI: DoD ProHciency Standards (ILR Descriptions) 


LEVEL 

FUNCTIONS/TASKS 

CONTEXT/TOPICS 

ACCURACY 

3 

Support Opinions 

Hypothesize 

Explain 

Deal with Unfamiliar topics 

Practical 

Abstract 

Special Interests 

Errors never interfere with communication 
and rarely disturb the native speaker 

2 

Narrate 

Describe 

Give directions 

Concrete 

Real-World 

Factual 

Intelligible even if not used to dealing 
with non-native speaker 

1 

Q and A 

Create with the Language 

Everyday survival 

Intelligible with effort or practice 

0 

Memorized 

Random 

Unintelligible 


3. Test Review and Evaluation 

The Arabic course is comprised of fifteen training units. Each succeeding unit is 
intended to further develop language skills by building on material previously learned in earlier 
units. These units span the three semesters, and each unit is accompanied by a major program 
test. Semester tests are given at the end of each semester and are considered to be major program 
tests as well. 

In May 1995, the Arabic language major program tests, known as C-Tests, underwent 
major revisions. The goal of the revisions was to tailor the curriculum so that the C-Tests would 
gradually reflect progressively higher proficiency levels in the functions, tasks, Context, and 
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topics depicted in Table 1.1. The development of performance FLO skills requires the 
development of reading, listening, and speaking skills. The C-Tests were designed to reflect a 
progression of the skills needed to ultimately achieve proficiency and performance FLO 
objectives at the end of the course. Material reflective of the real-world is incorporated into the 
tests to help achieve this. In developing the new C-Tests, the Arabic language program received 
general assistance and advice from the DLIFLC Test Development Division in database 
management and statistical analysis. 

The Arabic question format of C-Tests was changed from multiple-choice response to 
constructed response, except for semester tests. Semester tests remain multiple-choice. Because 
there is no single correct answer for constructed responses, a comprehensive list of acceptable 
responses for each question was compiled to guide teachers in grading and scoring. Graders are 
permitted to raise the question as to whether answers not found on the protocol are also correct. 
If such an answer is deemed as being acceptable by a program test review committee, the answer 
is added to the protocol. As the C-Tests were being developed, each test question on all eighteen 
C-Tests was evaluated for its difficulty and discriminating power. Difficult and redundant 
questions were eliminated. Beyond this, further Item Analysis has seldom been performed. 

The Persian language program has not undergone major revisions in its major program 
tests, known as phase tests, within the last ten years. There are six, multiple-choice response 
phase tests. The phase tests in place have not been validated nor undergone Item Analysis on a 
large scale. The content and tasks of each successive program test were not selected, when the 
tests were developed, to reflect a progression of the skills needed to achieve the proficiency and 
performance FLO objectives at the end of the course. However, the Persian department chair 
believes that the phase tests include content compatible with the progressive development of 
proficiency and performance FLO skills throughout the course. 
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4. 


Student Characteristics 


The overall student population is approximately 57 percent Army, 25 percent Air Force, 
12 percent Navy, five percent Marine Corps; the remainder are civilian or foreign service 
students. The percentage of language students arriving directly from Basic Military Training is 
approximately 75 percent for the Army, 81 percent for the Air Force, 86 percent for the Navy, 
and 60 percent for the Marine Corps. 

A language class could potentially consist of initial entry students, recycled students, and 
“re-languaged” students. Initial entry students are students new to the military. Recycled 
students are students placed back into a later class at a point within the course to make up 
deficiencies in performance. Re-languaged students are students who do not make satisfactory 
progress in a difficult language, such as Arabic; those students are then assigned to languages 
that are easier for English-speaking students to learn. Re-languaged students are seldom, if ever, 
placed into Arabic or Persian. 

B. LITERATURE REVIEW 

Although success on Arabic and Persian major program tests is germane to completing 
all course work in the language and success on the DLPT is germane to success on the job, no 
studies have been performed to determine the relationship between the two for either language. 
No studies have been done to determine if the cumulative skills GPA is predictive of DLPT 
performance nor have any studies been done to determine if the semester GPA is predictive of 
DLPT performance. However, DLDFLC has conducted a study, the Language Skill Change 
Project, to identify student characteristics predictive of DLPT performance. Additionally, a 
study relating performance objectives to DLPT performance has been conducted. 

The Language Skill Change Project Report n (O’Mara, Lett, and Alexander, 1994) 
reports that cognitive ability and aptitude, as measured by the DLAB, consistently predict 
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success in foreign language learning. However, student attitudes, motivation, and applied 
learning strategies also make significant contributions to the prediction of listening and reading 
skills. These results coincide with the results of a civilian study conducted by Ehrman and 
Oxford (1995) at the Foreign Service Institute of the U. S. Department of State. The variables 
tested were cognitive aptitude, learning strategies, personality, and motivation. Results show that 
cognitive aptitude, as measured by the Modem Language Aptitude Test (MLAT), is strongly 
correlated with proficiency. Motivational factors showed the next highest level of correlation 
with proficiency. 

Marchant (1998) performed a study that compared proficiency objectives (DLPT 
performance), performance objectives (performance FLO tests), and success at follow-on 
training. The population for her analysis included all twenty-one languages at DLIFLC. She 
found that in some languages such as Polish, the performance objectives are better predictors of 
success on the DLPT than in other languages. However, for Arabic and Persian, the performance 
objectives are not good predictors of DLPT success in listening, reading, or speaking. Overall, 
Marchant found that the performance FLO tests do not have consistent patterns of correlations 
with DLPT results across the languages or skills. Additionally, the DLPT reading and speaking 
portions are predictive of success at follow-on training for the Army Russian course but not for 
the Navy/Marine Corps Russian course. 

C. PROBLEM DESCRIPTION 

This study will determine if major program tests, cumulative skills GPAs, or semester 
GPAs are predictive of DLPT performance in the Arabic and Persian language programs. It will 
do this by determining the relationship between each major program test grade or semester GPA 
and the DLPT in listening, reading, and speaking. The relationship of cumulative skill semester 
GPAs to the DLPT will also be explored. 
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Additionally, this study will focus on sustained student performance across all three 
semesters and predictors of performance from test to test and semester to semester through the 
correlations among each of the major program tests, semester GPAs, and cumulative skills GPAs. 
With linear regression, we will also determine if the combination of all previous program tests or 
semester GPAs has a relationship to the next successive program test or semester GPA. 

Finally, if individual program tests are shown to have a strong relationship to DLPT 
performance, these particular test grades should be looked at more carefiilly before a decision is 
made to drop a student. To identify an appropriate point for recycling or dropping students, 
successive multiple linear regression in the chronological order of the tests will be used. 

None of the linear regression models include interactions because DLIFLC research 
personnel believe that the linear terms fully capture the models and that interaction terms are not 
interpretive for DLIFLC test performance. Residual analysis was done for the regression models 
to verify that the linear modeling assumptions are appropriate (Hamilton, 1992). The results of 
the residual analysis reveal that the errors have constant variance, the errors are normally 
distributed, and there are no signs of autocorrelation (errors are uncorrelated with each other). 

D. ORGANIZATION OF THESIS 

Chapter n is a description of the population, data, and variables considered. Chapter HI 
is a description of the methods used to analyze the Persian language program data and the results 
of the analysis. Chapter IV contains a description of the methods used to analyze the Arabic 
language program data and the results of the analysis. Chapter V contains a summary of the 
findings, the conclusions, and recommendations based on the findings. The Appendices present 
the tables, figures, and S-Plus results for the models. 
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11. DATA AND VARIABLES CONSIDERED 


DLIFLC maintains a database of all students who have attended the school. The 
database includes demographic and academic statistics for each student. DLPT scores were 
acquired from this database. Program test scores for both the Arabic and Persian language 
programs are maintained by each program and were acquired directly from them. 

A. BACKGROUND OF DATA 

Arabic C-Tests are evaluated based on the number of correct responses. Each skill 
portion (i.e., listening, reading, and speaking) of each test is assigned a raw score, the number of 
points awarded by the graders, based on correct responses. The raw score is then converted to a 
letter grade based on the current conversion table for that particular test. Eleven letter grades are 
possible. They are A, A-, B+, B, B-, C+, C, C-, D+, D, and F. The letter grade is archived for 
each student and kept on record for a period of one year. Grading is accomplished by teams, but 
team makeup changes over time. 

There is a separate conversion table (to letter grades) for each Arabic C-Test and for 
each skill portion of the test, except for speaking. The conversion from raw score to letter grade 
is invariant across C-Tests for speaking. The conversion tables are reviewed every six months, 
and if necessary, grade cut-offs are adjusted. This adjustment is to maintain a consistent 
distribution of letter grades across C-Tests. Generally, the Arabic language program desires 
approximately 15 percent of students to receive either an A or A-, 40 percent to receive either a 
B+, B, or B-, 35 percent to receive a C+, C, or C-, and the remainder to receive less than a C-. 

If the percentages in the six months of historical data sharply differ from these goals, the 
conversion table is adjusted for that particular skill portion of that particular test. In other words. 
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the conversion table of each skill portion of each C-Test is evaluated, and if necessary, adjusted 
based on six months of historical data. 

It is desired that the conversion from raw score to the letter grade be smooth. This means 
that the intervals for each letter grade should not be of greatly different magnitude (i.e., within 
the category of B scores, a B- of 31-33, a B of 34-36, and a B+ of 37-40, would be preferred to a 
B” of 31-32, a B of 33-39, and a B+ of 40). Conversions to letter grades lower than C- pose a 
problem since a score lower than a C— could spur the placement of a student onto probation. The 
cutoffs for C- and D-h receive particular attention to determine if students making lower than a 
C- are actually plausible candidates for probation. Conversely, there is concern to determine if 
there are any students scoring C*“ or higher who ultimately do not perform well on later tests. 

Due to the adjustment of the conversion tables, a raw score may be equivalent to one 
letter grade on a particular test at one point in time, and equivalent to a different letter grade on 
the same program test administered at another point in time. For example. Table n.l shows two 
grading scales for C-Test two in reading. Note how the raw score conversions of the last four 
rows differ. Data from six classes before April 1997 were used to produce the April 1997 scale 
and data from the six classes between April and October were used to produce the October 1997 
scale. There was no effort to produce conversions based on all the data available for the 
particular test, as with a moving average. 

Students in the Arabic language program are evaluated with a cumulative skills GPA and 
a semester GPA. A separate cumulative skills GPA is computed for each skill (listening, reading, 
and speaking) for each semester. Thus, three cumulative skills GPAs are computed at the end of 
every semester. The cumulative skills GPA for each semester in each skill is calculated based 
upon certain weights assigned to the C-Tests and certain weights assigned to the semester tests. 
The cumulative skills GPA scale ranges from 0.00 to 4.00 for each skill. The semester GPA is a 
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comprehensive average that includes the components of the cumulative skills GPAs for each 
semester and the grades for other subjects such as the area studies, geography, and history related 
to the language. It is computed by assigning certain weights to each of the course grades within a 
given semester. The semester GPA also is reported on a scale from 0.00 to 4.00. 


Table II.1: Arabic C-Test Two (Reading) Grading Scale 


15 Apr 97 

07 Oct 97 

Raw Score 

Letter Grade 

Raw Score 

Letter Grade 

56-55 

A 

56-55 

A 

54 

A- 

54 

A" 

53 

B-h 

53 

B+ 

52 

B 

52 

B 

51-50 

B- 

51-50 

B- 

49-47 

C+ 

49-47 

C+ 

46-44 

C 

46-44 

C 

43-41 

C- 

43-36 

C- 

40-35 

D+ 

35-33 

D+ 

34-25 

D 

32-25 

D 

24 

F 

24 

F 


Persian phase test grades are evaluated based on the number of correct responses. Each 
skill portion (i.e., listening, reading, and speaking) of each test is assigned a raw score based on 
correct responses. The raw score is then converted to a letter grade based on the conversion 
grade scale. However, the raw score, not the letter grade, is archived for each student. Tests are 
sometimes graded by teams, and often times by an individual. This may lead to inconsistencies 
in grading. 
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Unlike Arabic, the Persian departments do not have a separate grading scale for each 
Persian phase test or for each skill portion of the test. The current grading scale has been in 
place for at least five years, and there is one grading scale applied to every phase test in each 
skill. Adjustments to grades may be made if a class performs poorly on a phase test compared to 
previous classes. This adjustment is made after reviewing the class mean and standard deviation 
in comparison to other classes. The standard grading scale used by the Persian language program 
is shown in Table n.2. 

Persian language students are evaluated with a semester GPA. The Persian departments 
do not compute a cumulative skills grade like the Arabic language program, although each skill is 
assessed separately per phase test. The semester GPA is calculated in a fashion similar to that of 
Arabic. It is computed by assigning certain weights to each of the course grades within a given 
semester. Course grades are comprised of phase test grades and grades for other subjects such as 
the area studies, geography, and history related to the language. Again, it is reported on a scale 
from 0.00 to 4.00. 

Table II.2: Persian Phase Test Conversion Table 


Raw Score 

Letter Grade 

100-98 

A 

97-95 

A- 

94-91 

B-f 

90-87 

B 

86-84 

B- 

83-80 

C+ 

79-77 

C 

76-74 

C- 

73-68 

D 
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B. POPULATION CONSIDERED 


Training at DLIFLC consists of basic, intermediate, advanced, and specialized programs. 
However, the scope of this study is limited to students in the basic programs of Arabic and 
Persian language instruction. The basic program is largely composed of enlisted military 
students who have had one or fewer years of military service. 

In exploring the relationship between each major program test score, semester GPAs, 
cumulative skills GPA, and DLPT scores, we include students from nine Persian classes and nine 
Arabic classes who successfully completed all basic program course work and took the DLPT. 
The earliest Persian class considered is from FY93, with most classes falling between FY96 and 
FY97. The Arabic classes considered belong to FY96 through FY98. Since Arabic program test 
scores are categorical and Persian program test scores are numeric, it is impractical to analyze the 
Persian and Arabic data together or to report combined results. For DLPT analysis, the original 
Arabic data set contains records for 319 students, and the original Persian data set contains 
records for 232 students. However, due to missing test scores in the database, the data set was 
reduced to 268 Arabic and 161 Persian students. 

In exploring the relationship between each of the major program tests, the relationship of 
previous program tests to the next successive program test, and the relationship between each of 
the cumulative skills GPA and semester GPAs, we include students from nine Persian classes and 
nine Arabic classes who have data for all the variables of interest. For this analysis, the original 
Arabic data set contains records of 409 students, and the original Persian data set contains 
records of 232 students. Due to missing test scores in the database, the data set was reduced to 
311 Arabic and 209 Persian students. 

Cumulative skills GPAs are relevant only to the Arabic language program. Both the 
Arabic and Persian language programs appraise listening, reading, and speaking skills separately 
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on each of their major program tests. In the Arabic language program, the grades assigned to 
each skill portion of each test are averaged across a semester to make up the semester cumulative 
skills GPA for each of the three skills, weighted based on the semester, and used to determine a 
final cumulative skills GPA for each of the three skills. The Persian language program does not 
use a cumulative skills GPA because there are only six major program tests (two per semester) in 
Persian compared to eighteen major program tests in Arabic (eight in semester one, six in 
semester two, and four in semester three). 

C. VARIABLES 

A detailed listing of the variables is given in Table II.3. 

1. DLPT Analysis: Response Variables 

The response, or dependent, variables for this portion of the study are the scores obtained 
on the DLPT in listening, reading, and speaking. The DLPT is used as the standard for 
successful completion of the initial course of language instruction. There are three types of 
DLPT scores: raw, converted, and level. The raw score is the number of questions answered 
correctly, and the DLPT raw scores in listening and reading are based on a scale of 0 to 60 
points. This score is then transformed into the converted score, which is also based on a scale of 
0 to 60 points. These numeric, converted scores may then be transformed into level scores which 
is based on a scale of eleven points. The possible level scores are 0, 0+, 1,1+, 2, 2+, 3, 3+, 4, 4+, 
and 5. Levels 3+, 4, 4+, and 5 are not awarded at DLIFLC for reading and listening; however 
any score may be awarded for DLPT in speaking. The scale of level scores (Table I.l) indicates 
levels of proficiency for military linguists as defined by verbal descriptions approved by the 
Federal Interagency Language Roundtable. For this analysis, the converted scores are used. 
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2. DLPT Analysis: Predictor Variables 

The predictor variables used in this portion of the study are the listening, reading, and 
speaking major program test grades per test per semester, semester GPAs for three semesters, and 
for Arabic, the cumulative skills semester GPAs for listening, reading, and speaking. For Persian, 
program test scores are based on a scale of zero to 100. For Arabic, program test scores are 
converted letter grades based on a numeric score for each program test. Each program test’s 
conversion of the raw score to a letter grade is based on a different scale. Semester GPAs and 
cumulative skills GPAs range from 0.0 to 4.0. 

3. Program Test and GPA Analysis: Response/Predictor Variables 

The response and predictor variables for this portion of the study are the scores obtained 
on each of the program tests, semester GPAs, and cumulative skills GPAs. 

D. LIMITATIONS OF DATA 

The data obtained from the Persian language program consists only of those students 
who took the DLPT. It does not include those students who began the basic program and were 
later dropped due to academic or administrative reasons. Those program test scores and GPAs 
could have been useful in exploring the pairwise relationships among the program tests and 
GPAs. 

The data obtained from the Arabic language program is not in a standardized form for the 
period from 1^96 to FY98. Most of the program test scores are letter grades based on a 
changing, sliding scale. An ‘A’ on a particular program test for one particular class may not 
correspond to an ‘A’ on that same program test in another class at a later point in time. Numeric 
raw scores were obtained, where possible, but complete numeric raw scores for all program tests 
for any one particular class were not available in the Arabic language program database. Mixed 
forms (i.e., numeric and categorical) of the data could present confusing and meaningless results. 
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However, to a lesser degree, using just the categorical letter grade could also produce confusing 
results because of the sliding grade scales. For consistency, letter grades will be converted to 
their numerical equivalent as outlined in Table II.4 and used in the Arabic analysis. 


Table 11.3: Response and Predictor Variables 


Variable Name 

Description 

DLPT.L 

DLPT Listening Score 

DLPT.R 

DLPT Reading Score 

DLPT.S 

DLPT Speaking Score 

SEMl.GPA 

First Semester GPA 

SEM2.GPA 

Second Semester GPA 

SEM3.GPA 

Third Semester GPA 

LCSKl.GPA 

First Semester Listening Cumulative Skills GPA 

LCSK2.GPA 

Second Semester Listening Cumulative Skills GPA 

LCSK3.GPA 

Third Semester Listening Cumulative Skills GPA 

RCSKl.GPA 

First Semester Reading Cumulative Skills GPA 

RCSK2.GPA 

Second Semester Reading Cumulative Skills GPA 

RCSK3.GPA 

Third Semester Reading Cumulative Skills GPA 

SCSKl.GPA 

First Semester Speaking Cumulative Skills GPA 

SCSK2.GPA 

Second Semester Speaking Cumulative Skills GPA 

SCSK3.GPA 

Third Semester Speaking Cumulative Skills GPA 

LPHASEi 

Listening Persian Phase Test Score on test i, {i = 1,...,6} 

RPHASEi 

Reading Persian Phase Test Score on test i, {i = 1,. ..,6) 

SPHASEi 

Speaking Persian Phase Test Score on test i, {i = 1,. ..,6) 

LCi 

Listening Arabic C-Test Score on test i, {i = 8} 

RCi 

Reading Arabic C-Test Score on test i, {i = 1,...,18} 

SQ 

Speaking Arabic C-Test Score on test i, {i = 1,..,,18} 
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Table IL4: Letter Grade Numerical Equivalents 


LETTER 

GRADE 

NUMERICAL EQUIVALENT 

A 

4.0 

A- 

3.7 

B+ 

3.3 

B 

3.0 

B- 

2.7 

C+ 

2.3 

C 

2.0 

C- 

1.7 

D+ 

1.3 

D 

1.0 

F 

0.7 





















THIS PAGE INTENTIONALLY LEFT BLANK 


20 



III. PERSIAN LANGUAGE PROGRAM METHODOLOGY AND FINDINGS 


DLIFLC’s training goal is to have at least 80 percent of graduates in all basic courses 
meeting Level 2 in listening, reading, and speaking on the DLPT. The results obtained on the 
DLPT are used to award incentive pay and to assign follow-on training. Because of the 
importance of the DLPT in these two regards, DLIFLC is interested in identifying factors that are 
predictive of DLPT performance. The factors explored include major program tests and semester 
GPAs. 

Section A introduces preliminary analysis in the form of correlations and 
crosstabulations. Additionally, Section A focuses on sustained student performance on phase 
tests and semester GPAs as predicted by previous phase tests and semester GPAs. DLIFLC 
research personnel hypothesize that performance on previous tests or semester GPAs should be 
predictive of performance on a successive test or GPA (e.g., can we predict a student s 
performance on phase test three from his or her performance on phase tests one and two?). This 
relationship will be examined using multiple linear regression. Section B explores whether 
major program tests are predictive of DLPT performance. It does this by ascertaining the 
relationship between each program test grade and the DLPT in listening, reading, and speaking 
with stepwise linear regression. Section B also attempts to identify an appropriate point for 
recycling or removing students. Section C determines if semester GPAs are predictive of DLPT 
performance with a continuation ratio model and a classification tree. Section D identifies the 
overall best predictor of Persian DLPT performance. The tables applicable to the Persian data 
analysis are included in the text and Appendices A through F. 
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A. 


EXPLORATORY DATA ANA VLSIS RESULTS 


The results in this section are exploratory. The focus of this discussion is correlations 
and crosstabulations. In particular, we use correlations to describe the relationship among DLPT 
tests, phase tests, and semester GPAs. We also use crosstabulations to describe the relationship 
between the DLPT and semester GPAs. From the correlations and crosstabulations, conclusions 
cannot be made about the relationship among several variables at once, only between pairs of 
variables. Both the correlations and crosstabulations are included at the request of DLIFLC 
research personnel to help them gain a preliminary understanding of the data. Thus, a more 
detailed analysis (multiple regression) of the data describing the relationship between phase tests 
and semester GPAs is also included in Section A. In addition, multiple regression between the 
DLPT and phase tests examining the relationship among several variables at once is included in 
Section B. Descriptive statistics for variables are found in Appendix A. 

1. Correlations 

A correlation is a numerical summary used to measure the strength of the linear 
relationship between variables (Frees, 1996). It does not distinguish between a dependent and 
independent variable. Nor does it quantify relationships among several variables, only between 
pairs of variables. Linear regression is a way to understand the relationship among several 
variables at once. The results of the linear regression will be provided in Section B. 

We will define the correlation to be low, moderate or high if the correlation coefficient 
meets the following criteria: low if coefficient is between 0.01 and 0.400, moderate if correlation 
coefficient is between 0.401 and 0.699, and high if the coefficient is between 0.700 and 1.00. 
Appendix B lists pairwise correlations among all the phase tests, semester GPAs, and DLPT 
scores. However, as an example, the DLPT vs. DLPT correlation matrix is shown in Table El. 1. 
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From Table III.l, there appears, for the most part, to be moderate correlation among the DLPT 
skill tests. The DLPT reading and listening tests have the highest correlation at 0.581. 


Table IILl: Persian DLPT vs. DLPT Correlations 



DLPT,L 

DLPT.R 

DLPT.S 

DLPT.L 

1 

.581 

.469 

DLPT.R 

.581 

1 

.349 

DLPT.S 

.469 

.349 

1 


In regard to all correlations with the DLPT, we note that from Table B.l in Appendix B, 
the DLPT listening test has the highest correlations with phase tests two, five, and six across all 
three skills of listening, reading, and speaking. Likewise, the DLPT reading test has the highest 
correlations with phase tests two, five, and six across all three skills of listening, reading, and 
speaking. The DLPT speaking test has the highest correlations with phase tests two, five, and six 
in listening and reading and phase tests three, four, and six in speaking. These results agree with 
linear regression results obtained in Section B. From Table B.2 in Appendix B, we note that there 
is a low to moderate correlation between DLPT skill tests and semester GPAs. The DLPT 
speaking test and all three semester GPAs have moderate correlations with semester 3 GPA 
having the highest correlation at 0.561. The DLPT listening test and semester 1 and semester 3 
GPAs have moderate correlations as well at 0.476 and 0.477, respectively. The DLPT reading 
test is moderately correlated with semester 3 GPA at 0.408. 

Correlations between phase tests and between semester GPAs may be seen in Tables B.3, 
B.4, B.5, and B.6. Detailed relationships among phase tests and semester GPAs, to include 
determining the relationship among several variables at once, can be seen in Appendix C. 
Appendix C presents the results of the studies focusing on sustained student performance on 
phase tests and GPAs as predicted by other phase tests and GPAs. Multiple linear regression is 
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used to determine if student performance on previous phase tests can be used to predict 
performance on the next successive phase test in each respective skill of listening, reading, and 
speaking. The residual standard error (RSE), degrees of freedom (d.o.f.), unadjusted R^, and 
phase tests with significant p-values (p < 0.05) are reported for each model. The degrees of 
freedom vary from model to model because of missing test scores. This analysis follows 
Hamilton (1992). Overall, because of the low R'for each of the phase test models in Table C.l, 
it appears that previous tests are not as predictive of successive tests as we would like. To gauge 
the predictability of one test by other tests, the correlation table may be a better tool. The same 
holds true for the semester GPAs. 

2. Crosstabulations 

To get an idea of dependence, we analyze the data by cross-classifying it and obtaining a 
count of the number of cases in each cell. From this, a multi-way contingency table, or 
crosstabulation table, can be created to show the levels and counts. Like correlations, 
crosstabulations indicate relationships between pairs of variables and not the relationships among 
several variables at once. In this regard, it is limited in its value when several variables, such as 
three semester GPAs, are used as predictors. 

The crosstabulations show semester GPA intervals, one semester GPA at a time, that 
correspond to attaining minimum DLPT scores. When there are several predictor variables, a 
more useful tool in predicting semester GPA intervals that correspond to attaining minimum 
DLPT scores, taking into account all of the GPAs at once, is a classification tree, discussed in 
Section C. Appendix D details the crosstabulations between semester GPAs and achieving at 
least a 2/2/2, either a 2/2/1 or 2/2/1+, and less than a 2/2/1 on the DLPT. The categories are 
defined as follows: 2 - at least a 2/2/2, 1 - either a 2/2/1 or 2/2/1+, 0 - not achieving at least a 
2/2/1. The 2/2/1 and 2/2/1+ are combined because a student who receives a 2/2/1+ is not eligible 
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for follow-on training at Fort Huachuca, whose DLPT cutoff is 2/2/2, but is eligible for training 
at Goodfellow AFB. 

The cell of each semester “GPA interval” contains the number of students falling within 
a particular GPA range and the percentage within that row. For example. Table in.2 shows the 
crosstabulations of semester one GPA to the DLPT score. For the first semester GPA, it appears 
that students with a GPA of 2.9 or greater are most likely to get at least a 2/2/2 on the DLPT 
since the row percentages in category 2 for GPAs at least 2.9 are all greater than 75%. For 
example, 80.5% of the students with GPAs between 3.0 and 3.2 finished in category 2. Results of 
obtaining a 2/2/1 or 2/2/1+ on the DLPT are also shown. 

Figure 1 is a boxplot that provides us with a graphical representation of the column 
spread of the first semester GPA versus the three categories. It shows that there is roughly 
constant variability across the three categories. We see that the median first semester GPA for 
category 2 is about 3.3, whereas the medians for category 0 and 1 are approximately the same at 
2.9. Please see Hamilton (1992) for a detailed description of boxplots. 


Table 111.2: Persian DLPT and First Semester GPA Crosstabulations 


First Semester 

GPA Intervals 

Category 


0 (less than 2/2/1) 

1 (2/2/1 or 2/2/1+) 

2 (2/2/2 or better) 


n 

16 

10 

12 

% 

.421 

.263 

.316 

2.8-2.9 

n 

10 

7 

11 

% 

.357 

.250 

.393 

2.9-3.0 

n 

0 

2 

10 

% 

0 

.167 

.833 

1 

o 

n 

5 

3 

33 

% 

.122 

.073 

.805 

3.2-3.5 

n 

4 

3 

40 

% 

.085 

.064 

.851 

3.5-3.7 

n 

4 ^ 

4 

25 

% 

.121 

.121 

.758 

gumm 

n 

4 

0 

27 

% 

.129 

0 

.871 

1 Column Totals 

43 

29 

158 


25 
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Figure 1: Persian Boxplot of Category versus First Semester GPA 


Appendix D shows that for the second semester GPA, individuals with a GPA greater 
than 2.3 are highly likely to get at least a 2/2/2 on the DLPT. This is without taking first 
semester GPA into account. For the third semester GPA, it appears that individuals with a GPA 
greater than 3.0 are highly likely to get at least a 2/2/2 on the DLPT, again ignoring first and 
second semester GPAs. These results provide us with GPA intervals that correspond to DLPT 
performance with respect to just one semester GPA at a time. It does not consider the 
interactions of the three semester GPAs. Consequently, it is not the best method for predicting 
DLPT performance based on semester GPAs. 

B. PREDICTING DLPT PERFORMANCE WITH PHASE TESTS 

Stepwise linear regression, with backward elimination, is performed to determine the 
relationship of the DLPT to the phase tests. Stepwise regression is a multiple linear regression 
technique that selects a set of independent variables for inclusion. Backward elimination chooses 
a subset of models by starting with the full model and then eliminating at each step the one 
variable whose deletion will cause the residual sum of squares to increase the least (Rawlings, 
1988). The first set of models (“full” models) consists of all six phase tests taken over the course 
of three semesters. The second set of models (“partial” models) consists only of tests taken the 
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first two semesters. The second set of models is included because DLIFLC is more likely to 
recycle or drop a student during the first two semesters than in the third semester. As a 
consequence, it is important to DLIFLC to know which first and second semester tests are 
predictive of DLPT performance. As stated in Chapter H, Section A, interaction terms are not 
considered in these models at the request of DLIFLC research personnel, and residual analsyis 
was performed to ensure the linear modeling assumptions are appropriate. 

We believe that program tests administered in the second and third semesters, especially 
phase tests four, five, and six, will be the best predictors of DLPT performance. These tests tend 
to focus more on the proficiency of the student rather than achievement, as earlier tests do. 

The low of the full and partial models reveal that there is a lot of variation in the 
DLPT that cannot be explained by the phase tests. However, we must take note that within the 
full models, the stepwise regression identifies at least one test from the beginning of the course 
and two phase tests from the end of the course as being predictive of DLPT performance. The 
results of these three models support DLIFLC’s belief that tests administered in the latter part of 
the course will be predictive of DLPT performance but it also verifies the importance of earlier 
tests. In all three models, phase test six was identified as a predictor, and phase test five was 
identified in two of the models. Within the partial models, stepwise regression identified phase 
test two in all three models and phase test four in two of the models. Phase test two is 
administered in the first semester and phase test four is administered in the second semester. 
Even less variability is explained by the partial models than the full models. 

1. Full Models 

Using stepwise regression to fit the DLPT in each of the three skills versus the six phase 
tests in each skill gives the following models for listening, reading, and speaking, respectively: 

DLPT.L = 19.5 + 0.082 LPHASE2 + 0.087 LPHASE5 + 0.132 LPHASE6, (1) 
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with a residual standard error of 3.38 on 161 degrees of freedom and of 0.351; 

DLPT.R = 16.0 + 0.070 RPHASEl + 0.120 RPHASE5 + 0.153 RPHASE6, (2) 

with a residual standard error of 4.96 on 161 degrees of freedom and R^ of 0.234; and 

DLPT.S = -16.7 + 0.081 SPHASE2 + 0.102 SPHASE3 + 0.219 SPHASE6, (3) 

with a residual standard error of 3.16 on 161 degrees of freedom and R^ of 0.275. 

Table III.3 includes the coefficient values and the associated standard errors obtained 
from the full model stepwise regression results. 

2. Partial Models 

The partial models contain only the four tests taken during the first two semesters. These 
models are included because DLIFLC is more likely to recycle or drop a student during the first 
two semesters than the third semester. As a consequence, it is important to DLIFLC to know 
which first and second semester tests are predictive of DLPT performance. 

Using stepwise regression to fit the DLPT in each of the three skills versus the four phase 
tests in each skill gives the following models for listening, reading, and speaking, respectively: 

DLPT.L = 26.6 + 0.134 LPHASE2 + 0.088 LPHASE4, (4) 

with a residual standard error of 3.61 on 162 degrees of freedom and R' of 0.254; 

DLPT.R = 23.8 + 0.096 RPHASEl + 0.150 RPHASE2, (5) 

with a residual standard error of 5.41 on 162 degrees of freedom and R^ of 0.089; and 

DLPT.S = -12.9 + 0.091 SPHASE2 + 0.127 SPHASE3 + 0.143 SPHASE4, (6) 

with a residual standard error of 3.27 on 161 degrees of freedom and R^ of 0.221. 

Table 111.4 includes the coefficient values and the standard errors associated with the 
coefficients obtained from the partial model stepwise regression results. 
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Table IIL3: Results of Stepwise Linear Regression on Persian Full Model 


’ 

Coefficient Value 

Standard Error 

Full Mode! 1(DLPT.L): 



Intercept 

19.5 

3.10 

LPHASE2 

0.082 

0.033 

LPHASE5 

0.087 

0.042 

LPHASE6 

0.132 

0.033 

Full Model 2 (DLPT.R): 



Intercept 

16.0 

4.96 

RPHASEl 

0.070 

0.044 

RPHASE5 

0.120 

0.050 

RPHASE6 

0.153 

0.054 

Full Model 3 (DLPT.S): 



Intercept 

-16.7 

4.83 

SPHASE2 

0.081 

0.043 

SPHASE3 

0.102 

0.045 

SPHASE6 

0.219 

0.050 





































Table 111.4: Results of Stepwise Linear Regression on Persian Partial Model 



Coefficient Value 

Standard Error 

Partial Model 4 (DLPT.L): 



Intercept 

26.6 

2.53 

LPHASE2 

0.134 

0.035 

LPHASE4 

0.088 

0.031 

Partial Model 5 (DLPT.R): 



Intercept 

23.8 

5.76 

RPHASEl 

0.096 

0.048 

RPHASE2 

0.150 

0.051 

Partial Model 6 (DLPT.S): 



Intercept 

-12.9 

5.11 

SPHASE2 

0.091 

0.045 

SPHASE3 

0.127 

0.047 

SPHASE6 

0.143 

0.055 


Now that we have shown which program tests provide some measure of predictability of 
DLPT performance, we also want to identify an appropriate point for recycling or dropping 
students. We seek to answer the question “which tests should be looked at more carefully before 
a decision is made to drop a student?” An approach to answering this question is successive, 
multiple linear regression by adding the program tests in their chronological order. This analysis 
was performed, and the program tests with a significant change in R‘ (increase of 0.05 or greater) 
and a significant F-statistic were the exact same tests identified in the stepwise regression full 
models. The F-statistic measures the change in goodness of fit of the model if a variable is added 
or deleted from the model. By adding or deleting a test, it can be determined if the model is 
significantly better or worse. The results are included in Appendix E. 


30 





































C. PREDICTING DLPT PERFORMANCE WITH SEMESTER GPAS 

This portion of the study determines if semester GPAs are predictive of DLPT 
performance. It does this by exploring the relationship of semester GPAs to achieving at least a 
2/2/2, either a 2/2/1 or a 2/2/1+, or less than a 2/2/1 on the DLPT. The categories are defined as 
follows: 2 - at least a 2/2/2,1 - either a 2/2/1 or 2/2/1+, 0 - not achieving at least a 2/2/1. A 
secondary goal of this analysis is to determine cutoff GPAs associated with these DLPT 
categories. The probabilities of achieving each category as a function of semester GPA are 
estimated. 

1. Continuation Ratio Model 

The analysis is performed based on a continuation ratio model for a multinomial 
response variable (i.e., the response variable that indicates whether an individual achieves a 
category 0, 1, or 2 is modeled as a multinomial response). The underpinnings of the ratio model 
require the analysis to be done in two separate logistic regression sub-models. The first sub¬ 
model determines the likelihood of getting at least a 2/2/1 response as a function of semester 
GPAs. The second sub-model determines the likelihood of getting at least a 2/2/2 among those 
who have at least a 2/2/1 as a function of semester GPAs. Thus, we fit a continuation ratio model 
(McCullagh and Nelder, 1983) which is a generalization of a logistic regression model where the 
response is binary. 

To ensure the continuation ratio model is appropriate for the Persian data, a generalized 
additive model is fitted to the data (Hastie and Tibshirami, 1990). In particular, for the 
continuation ratio model to be appropriate. Equations (7) and (8) are equivalent to requiring that 
the logit of the probabilities (left hand side of Equations (7) and (8)) be linear in the semester 
GPAs. The results of the generalized additive model shows that this is the case for the Persian 
data. 
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The formulation of the ratio model is as follows: 

Let Yi be the category of DLPT score received by each individual student, where 

2 if the student gets 2/2/2 or better on DLPT, 

Yj = < 1 if the student gets 2/2/1 or 2/2/1 + on DLPT, 

0 if the student scores below 2/2/1 on DLPT. 

For the first logistic regression sub-model, let 

{ 1 if Yi is equal to 1 or 2 for student i, 

0 if Yi is equal to 0 for student i 

be the binomial response variable with the three semester GPAs as the predictors. The 
semester GPA coefficients from the model are the P’s for the following equation: 

P(Yi = lor2IGPAs) = 

exp(po + pi SEMI.GPA+P 2 SEM2.GPA+p3 SEM3.GPA) (7) 

l + exp(po+pi SEMl.GPA+p 2 SEM2.GPA+p3 SEM3.GPA)‘ 

For the second logistic regression sub-model analysis, let 


{ 1 if Yi is equal to 2 for student i, 

0 otherwise 

be the binomial response variable with the three semester GPAs as the predictors. The 
semester GPA coefficients from the model are the P’s for the following equation: 

P( Yi = 21 Yi = 1 or 2 and GPAs) = 

exp(po + Pi SEMI .GPA+ P 2 SEM2.GPA + P3 SEM3.GPA) (g) 

l + exp(Po + pi SEMI.GPA- 1 -P 2 SEM2.GPA + p3 SEM3.GPA) ' 

Under the null hypothesis that the fitted model is correct, the residual deviance of each 

logistic regression sub-model has approximately the distribution (Hamilton, 1992). The 

residual deviance for the first sub-model is 191.8 with 227 degrees of freedom, and for the 

second sub-model, the residual deviance is 139.6 with 184 degrees of freedom. For logistic 
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regression, the % approximation can be poor. Therefore, it is prudent not to read too much 
into the lack of fit tests based on the residual deviance. However, because both residual 
deviances are less than their respective degrees of freedom, there does not appear to be 
strong evidence of a lack of fit by the two logistic sub-models. From the statistical results of 
the sub-models presented in Appendix F, the sub-models reveal that the second semester 
GPA is a less significant predictor of DLPT performance than first and third semester GPAs. 

The values from Equations (7) and (8) for each student are then used in Equations (9), 
(10), and (11) to calculate individual probabilities of getting at least a 2/2/2, either a 2/2/1 or 
2/2/1+, and less than a 2/2/1, respectively for that student. The equations are: 

P(Yi = 2) = P(Yi = 1 or 21 GPAs) * P(Yi = 21 Yi = 1 or 2 and GPAs) , (9) 

P(Yi = 1) = [1 - P(Yi = 21 Yi = 1 or 2 and GPAs)] * P(Yi = 1 or 21 GPAs), (10) 

P(Yi = 0) = l-P(Yi=lor2IGPAs). (11) 

For example, a student has the following semester GPAs: SEMI.GPA = 3.8, 
SEM2.GPA=3.9, SEM3.GPA=3.9. In this instance, Y*i = 1 and Z*i = 1. Substituting the 
coefficients of the first generalized linear sub-model into Equation (7) yields 
P(Yi = lor2IGPAs) = 

exp(-4.72 + 1.34 SEMl.GPA-.920 SEM2.GPA+1.56 SEM3.GPA) 
l + exp(-4.72 + 1.34 SEMl.GPA-.920 SEM2.GPA+1.56 SEM3.GPA) 

= 0.946. 
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Substituting the coefficients of the second generalized linear sub-model into Equation (8) 
yields 

P(Yi = 21 Yi = 1 or 2 and GPAs) = 

exp(-5.84+1.48 SEMl.GPA +.561 SEM2.GPA +.384 SEM3.GPA) 
l-hexp(-5.84 +1.48 SEMl.GPA +.561 SEM2.GPA +.384 SEM3.GPA) 

= 0.970. 

Substituting the results of Equations (7) and (8) into Equations (9), (10), and (11) yields 

P(Yi = 2) = 0.946 * 0.970 = 0.918, P(Yi = !)=[! -0.970] * 0.946 = 0.028, and 

P(Yi=0)= (1-0.946) = 0.054. 

We estimated that this particular individual had probability 0.918 of getting at least a 
2/2/2,0.028 of getting a 2/2/1 or 2/2/1+, and 0.054 of not getting at least a 2/2/1 based on his or 
her semester GPA scores. In fact, this student scored a 2/2/2 on the DLPT. The continuation 
ratio model allows you to estimate probabilities only for an individual student based on that 
student’s GPAs. The misclassification rate of this model is estimated to be 29.2%. 

2. Classification Tree Model 

We have seen that the continuation ratio model allows us to estimate individual 
probabilities of getting at least a 2/2/2, either a 2/2/1 or a 2/21+, and less than a 2/2/1 for each 
student. A classification tree is a nonparametric version of the continuation ratio model. 
Classification trees have a categorical response variable in contrast to regression trees, which 
have a continuous response variable. Pruning is used to obtain optimal tree size. This analysis 
follows Chambers and Hastie (1992) and Venables and Ripley (1997). Please refer to Figure 2. 
The percentages under each node or leaf represents the predicted percentages of students 
obtaining less than a 2/2/1, either a 2/2/1 or 2/2/1+, or a 2/2/2, in that order. The categories are 
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defined as follows: 2 - at least a 2/2/2,1 - either a 2/2/1 or 2/2/1+, 0 - not achieving at least a 
2/2/1. Each node or leaf contains the sample size for that leaf or node. 

As with the continuation ratio model, the first semester GPA is more predictive of DLPT 
performance than the second semester GPA. Although all three semester GPAs are included as 
predictor variables, the third semester GPA does not appear in the tree because the first and 
second semester GPAs capture all of the third semester GPA predictive abilities. The tree 
indicates that if an individual has a first semester GPA greater than 2.95, the individual will 
receive a 2/2/2 on the DLPT with probability of 0.82. If an individual has a first semester GPA 
less than 2.25, he or she will receive less than a 2/2/1 on the DLPT with probability of 0.86. A 
tree model is superior to crosstabulations in its ability to take into account interactions and 
multiple predictors to predict DLPT performance. Overall, the misclassification rate of the tree 
based on the data is estimated to be 26%. Although the semester GPA includes grades that are 
not exclusively phase test listening, reading, and speaking grades, they appear to be good 
predictors of DLPT performance. 
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D. BEST OVERALL PREDICTOR OF DLPT PERFORMANCE 

We have identified which phase tests are independently predictive of DLPT performance 
for each skill and which semester GPAs and their related cutoff scores are predictive of DLPT 
performance. We would also like to identify what the overall best predictors are of DLPT 
performance, taking into account all three semester GPAs and all of the phase tests for all three 
skills. This answers the question: “Given everything we know academically about the student 
(i.e., listening, reading, and speaking phase test grades and semester GPAs), what is the best 
predictor of DLPT performance?” Figure 3, a classification tree, answers this question. As in 
Figure 2, the percentages under each node or leaf represents the predicted percentages of students 
obtaining less than a 2/2/1, either a 2/2/1 or 2/2/1+, or a 2/2/2, in that order. Each node contains 
the sample size for that node. It identifies the first semester GPA and listening phase tests four 
and five as being the most predictive. The sample size at the root node is smaller in Figure 3 than 
Figure 2 because of missing test and GPA scores. This model’s overall misclassification rate is 
estimated to be 22.3%. 
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Figure 3: Overall Persian DLPT Performance Predictors 



Sample Size 



Cat 0%/Cat 1%/Cat 2% 

(less than 2/2/1,2/2/1 or 2/2/1+, 2/2/2 or greater) 








IV. ARABIC LANGUAGE PROGRAM METHODOLOGY AND FINDINGS 


The results of the Arabic analysis are presented in a fashion similar to those of the 
Persian analysis. Generally, the sections are the same with the addition of the cumulative skills 
semester GPA analysis. 

A. EXPLORATORY DATA ANAYLSIS RESULTS 

The results in this section are exploratory. Conclusions cannot be made as to the 
relationship among several variables at once, only pairs of variables. Both the correlations and 
crosstabulations are included at the request of DLIFLC research personnel to help them gain a 
preliminary understanding of the data. Detailed analysis of the data, to include determining the 
relationship among several variables at once, begins in Section B. The tables applicable to the 
Arabic data analysis are included in Appendices G through M. 

1. Correlations 

We define the correlation to be low, moderate or high if the correlation coefficient meets 
the following criteria; low if coefficient is between 0.01 and 0.400, moderate if correlation 
coefficient is between 0.401 and 0.699, and high if the coefficient is between 0.700 and 1.00. 
Appendix H lists all pairwise correlations among all the C-Tests, semester GPAs, cumulative 
skills GPAs, and DLPT scores. 

From Table H. 1 in Appendix H, we note that there is a moderate correlation between the 
DLPT skill tests. As in the Persian results, the DLPT reading and listening tests have the highest 
correlation at 0.660. 

From Tables H.2. H.3, and H.4 in Appendix H, the DLPT listening test has the highest 
correlations with listening C-Tests ten, eleven, semester test two, and all four tests taken in 
semester three. It has the highest correlations with reading C-Tests eleven, twelve, fifteen, and 
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semester test three. The DLPT listening test also has the highest correlations with speaking C- 
Tests semester test two and all four tests taken in semester three. Likewise, the DLPT reading 
test has the highest correlations with listening C-Tests ten, eleven, and semester test two, and all 
four tests taken in semester three. It has the highest correlations with reading C-Tests nine 
through twelve and thirteen through semester test three. The DLPT reading test also has the 
highest correlations with speaking C-Tests twelve, fourteen, fifteen, and semester test three. The 
DLPT speaking test has the highest correlations with C-Tests semester test two and fifteen in 
listening, C-Tests eleven and twelve in reading, and C-Tests twelve, semester test two, fourteen, 
fifteen, and semester test three in speaking. In summary, the DLPT tests appear to have higher 
correlation coefficients for the latter half of semester two tests and a predominance of semester 
three tests across all skills. The correlations with semester one tests appear to be the lowest 
across all three skills. 

From Table H.5 in Appendix H, we note that there are moderate correlations between 
DLPT skill tests and semester GPAs. The DLPT listening, reading, and speaking tests have the 
highest correlations with semesters 2 and 3 GPAs. The highest correlation observed is that of 
semester 3 GPA and the reading portion of the DLPT test at 0.679. Table H.6 displays the 
correlations between the DLPT skill tests and the cumulative skills GPAs. The DLPT listening 
test is moderately correlated with the three listening cumulative skills GPAs at 0.550, 0.628, and 
0.632, respectively. The DLPT reading test is moderately correlated with the three listening 
cumulative skills GPAs at 0.560, 0.581, and 0.676, respectively. However, it is worth mentioning 
that two of the highest correlations are with listening cumulative skills GPAs two and three at 
0.620 and 0.606, respectively. The DLPT speaking test has the highest correlations with the three 
listening cumulative skills GPAs at 0.520,0.587, and 0.499 and the speaking cumulative skills 
GPAs two and three at 0.507 and 0.501, respectively. 
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Detailed relationships among C-Tests, cumulative skills semester GPAs and semester 
GPAs, to include determining the relationship among several variables at once, can be seen in 
Appendix I. Appendix I presents the results of the studies focusing on sustained student 
performance on C-Tests and GPAs as predicted by other C-Tests and GPAs. The models in this 
section are the same as that used in the Persian analysis in Chapter HI, Section A. The residual 
standard error (RSE), degrees of freedom (d.o.f.), unadjusted R^, and phase tests with significant 
p-values (p < 0.05) are reported for each model. The analysis in this section follows Hamilton 
(1992). As in Persian, the degrees of freedom vary from model to model because of missing test 
scores. 

To determine if student performance on previous C-Tests can be used to predict 
performance on the next successive C-Test, we refer to Tables 1.1 through 1.3. From Table 1.1, 
we observe that LSOl and LC08 tests are the most predictive of future test performance. These 
two tests are identified as having p-values less than 0.05 for five of the ten models they are 
included in. From Table 1.2 we note that RC04 and RSOl are the most predictive with RS04 
being identified in five of the models and RSOl being identified in six of the models as having 
p-values less than 0.05. Tests SCOl, SC04, and SCO? are identified in Table 1.3 as being the 
most predictive tests of future test performance. Based on these results, we may infer that to a 
small degree performance on future C-Tests may be assessed by performance on past C-Tests 
especially in the simple linear regression case. However, we should note that there is much 
variability in the models that is not explained by the program tests. 

To determine if student performance in previous semester GPAs/cumulative skills 
semester GPAs can be used to predict other semester GPAs/cumulative skills semester GPAs, we 
refer to Tables 1.4 and 1.5. From Table 1.4, it appears previous semester GPAs are highly 
predictive of future semester GPAs, especially in regards to semester two GPA being predictive 
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of semester three GPA. That model has a high R' of 0.718. In Table 1.5 we see that is 
moderately high (above 0.50) for four of the six models. Thus, it appears that previous 
cumulative skills semester GPAs can be a useful tool in predicting future cumulative skills 
semester GPAs. 

2. Crosstabulations 

The crosstabulations in Appendices J and K show semester GPA and cumulative skills 
semester GPA intervals, one GPA at a time, that correspond to attaining minimum DLPT scores. 
Appendix J details the crosstabulations of semester GPAs to achieving at least a 2/2/2, either a 
2/2/1 or 2/2/1+, and less than a 2/2/1 on the DLPT. The categories are defined as follows: 2 - at 
least a 2/2/2, 1 - either a 2/2/1 or 2/2/1+, 0 - not achieving at least a 2/2/1. The cell of each 
semester GPA interval contains the number of students falling within a particular GPA range, the 
percentage within that row, and the percentage within that column. The semester GPA 
crosstabulation results are presented in a fashion similar to those of Chapter IE, Section A, 
subsection (2). Appendix J shows that for the first semester GPA, individuals with a GPA 
greater than 3.2 are highly likely to get at least a 2/2/2 on the DLPT. The same holds true for 
second and third semester GPAs - having at least a 3.2 semester GPA characterizes the individual 
as being likely to get a 2/2/2 on the DLPT. Results of obtaining a 2/2/1 on the DLPT are also 
presented in Appendix J. 

Appendix K details the crosstabulations of cumulative skills semester GPAs by skill with 
achieving at least a level 2 in that particular skill and with achieving either a level 1 or 1+ in that 
particular skill. The categories for each skill are defined as follows: 2 - at least a level 2,1 - 
either a level 1 or 1+, 0 - not achieving at least a 1. For example. Table IV. 1 shows the 
crosstabulations of listening cumulative skills semester one GPA to the listening DLPT score. 
For the first listening cumulative skills semester GPA, it appears that students with a GPA of at 
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least 2.0 are most likely to get at least a level 2 on the listening portion of the DLPT since the 
row percentages for GPAs greater than 2.0 in category 2 are at least 64%. 

Appendix K shows that for the second and third listening semester cumulative skills 
GPAs, individuals with a GPA greater than 2.0 are also highly likely to get at least a level 2 on 
the listening portion of the DLPT. To obtain at least a level 2 on the reading portion of the 
DLPT, a minimum GPA of 1.0 is required for all three reading cumulative skills semester GPAs. 
For speaking, a minimum GPA of 3.2 is required for all three speaking cumulative skills semester 
GPAs in order to achieve at least a level 2 on the speaking portion of the DLPT. Results of 
obtaining a level 1 on the DLPT are also presented in Appendix K. 

As stated in Chapter H, these results provide us with GPA intervals that correspond to 
DLPT performance with respect to just one semester GPA or cumulative skills GPA at a time. It 
does not consider the interactions of the three semester GPAs or cumulative skills GPAs. 

Table IV.l: Arabic DLPT.L and Listening Cumulative Skills First Semester GPA Crosstabulations 


Listening First Semester 

GPA Intervals 

Category 


0 (less than 1) 

1 (1 or 1+) 


mm 

n 

0 

24 

31 

% 


.436 

.564 

2.0-2.5 

n 

0 

29 

52 

% 


.358 

.642 

2.5-2.9 

n 

0 

8 

41 

% 


.163 

.837 

2.9-3.2 

n 

0 

6 

32 

% 


.158 

.842 

3.2-3.5 

n 

0 

0 

19 

% 



1.00 


n 

0 

0 

17 

% 



1.00 


n 

0 

0 

10 

% 



1.00 

1 Column Totals 

0 

67 

202 
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B. 


PREDICTING DLPT PERFORMANCE WITH C-TESTS 


Regression tree analysis is performed to determine the relationship of the DLPT to the 
C-Tests. Regression trees have a continuous response variable. The results are presented with 
two sets of models similar to those in the Persian analysis done in Chapter III, Section B. The 
full models, shown in Figures 4,6, and 8, use all eighteen C-Tests taken over the course of three 
semesters. The partial models, shown in Figures 5,7, and 9, use only tests taken during the first 
two semesters. The predicted value of the response variable is printed inside the node. The node 
size is listed underneath each node or leaf. The second set of models is included because 
DLIFLC is more likely to recycle or drop a student during the first two semesters than the third 
semester. As a consequence, it is important to DLIFLC to know which first and second semester 
tests are predictive of DLPT performance. 

We see in Figure 4 that listening C-Tests eleven and fifteen, and listening semester tests 
two and three are identified as being the most predictive of DLPT listening performance. In 
Figure 5, listening C-Tests eleven and semester test two are again identified as predictive of 
DLPT performance, as well as listening C-Tests five, eight and listening semester test one. In 
Figure 6, reading C-Tests four, fourteen, fifteen, and semester test three are identified as being 
predictive of reading DLPT performance. Figure 7 identifies reading C-Tests eight, eleven, and 
twelve. In Figure 8 we see speaking C-Tests eleven, twelve, and semester three test as being 
predictive of speaking DLPT performance. Figure 9 displays speaking C-Tests one and semester 
test two. Not surprisingly, each of the full models mainly identified tests administered towards 
the latter part of the last two semesters. 

As in the Persian analysis in Chapter IE, Section B, we want to identify an appropriate 
point for recycling or dropping students. This analysis was performed in the same manner as the 
Persian analysis, and the program tests with a significant F-statistic and significant change in R' 
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(change of 0.05 or greater) are not the same tests identified in the full model regression trees. 
Please refer to Appendix L. It is expected that both models (multiple linear regression and 
regression trees) would yield similar results although one is parametric and the other is 
nonparametric. The discrepancy between the two models cannot be explained. 
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Figure 4: Listening DLPT Performance Predictors in Arabic (Full Model) 


Legend: 
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Figure 5: Listening DLPT Performance Predictors in Arabic (Partial Model) 


Legend: 


Predicted DLPT ListeningScore 


N (node size) 
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Figure 6: Reading DLPT Performance Predictors in Arabic (Full Model) 
Legend: 


Predicted DLPT ReadingScore 


N (node size) 
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Figure 7: Reading DLPT Performance Predictors in Arabic (Partial Model) 


Legend: 


Predicted DLPT ReadingScore 


N (node size) 
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Figure 9: Speaking DLPT Performance Predictors in Arabic (Partial Model) 









C. PREDICTING DLPT PERFORMANCE WITH SEMESTER GPAS 

We wish to determine if semester GPAs are predictive of DLPT performance. Again, we 
do this by exploring the relationship of semester GPAs to achieving at least a 2/2/2, either a 2/2/1 
or 2/2/1+, or less than a 2/2/1 on the DLPT. The associated probabilities of achieving each are 
calculated as well. The model formulations are exactly the same as in the Persian analysis shown 
in Chapter El. 

1. Continuation Ratio Model 

The analysis in this section follows Chapter m. Section C, sub-section (1). Once again, 
the appropriate semester GPA coefficients from the model are the P’s for Equations (7) and (8). 
Equations (9), (10), and (11) are calculated in a like manner. The misclassification rate of this 
model is estimated to be 40.8%. Refer to Appendix M to review the pertinent logistic regression 
models. 

To ensure the continuation ratio model is appropriate for the Arabic data, a generalized 
additive model is fitted to the data (Hastie and Tibshirami, 1990). In particular, for the 
continuation ratio model to be appropriate. Equations (7) and (8) are equivalent to requiring that 
the logit of the probabilities (left hand side of Equations (7) and (8)) be linear in the semester 
GPAs. The results of the generalized additive model show that this is not the case for the Arabic 
data. Thus, it is more apropos to fit a nonparametric model (classification tree) to the data. 

2. Classiflcation Tree Model 

The analysis in this section follows Chapter HI, Section C, sub-section (2). In Chapter IE, 
we noted that the continuation ratio model allows us to calculate individual probabilities of 
getting at least a 2/2/2, either a 2/2/1 or 2/2/1+, or less than a 2/2/1 for each student, but if 
standard cutoff GPAs are needed independent of the student, a classification tree model is more 
appropriate. Please refer to Figure 10. 


52 




Although all three semester GPAs are included as predictor variables, the first semester 
GPA does not appear in the tree because the second and third semester GPAs capture all of the 
first semester GPA predictive abilities. The second and third semester GPAs are more predictive 
of DLPT performance than the first semester GPA. Each node of the tree contains the sample 
size used in the splitting of that node. Underneath each node are the classification percentages 
related to DLPT performance in the following manner: not obtaining at least a 2/2/1, obtaining 
either a 2/2/1 or 2/2/1+, or obtaining at least a 2/2/2. The tree indicates that if an individual has a 
second semester GPA greater than 2.85, the student will receive a 2/2/2 on the DLPT with 
probability of 0.64. Overall, the misclassification error rate of the tree is estimated to be 37%. 
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D. PREDICTING DLPT PERFORMANCE WITH CUMULATIVE SKILLS GPAS 


This portion of the study determines if cumulative skills semester GPAs are predictive of 
DLPT performance. It does this by exploring the relationship of cumulative skills semester GPAs 
in listening, reading, and speaking to achieving at least a level 2 in the particular skill and to 
achieving either a level 1 or 1+ in the particular skill. The categories for each skill are defined as 
follows: 2 - at least a level 2,1 - either a level 1 or 1+, 0 - not achieving at least a level 1. The 
percentages under each node or leaf represent the predicted percentages of students in category 0, 
1, and 2, in that order. However, because no students fell into category 0, there are no 
percentages associated with this category in the listening models, only categories 1 and 2. Each 
node contains the sample size for that node. 

The full models, shown in Figures 11 and 13, consist of all three cumulative skills 
semester GPAs. The partial models, shown in Figures 12 and 14, consist only of cumulative 
skills semester GPAs from the first two semesters. Trees for the reading cumulative skills 
semester GPAs are not included because analysis revealed the root node as being the best model 
for the full and partial models. There is a 0.97 probability for both models that a student will 
receive a 2 on the reading portion of the DLPT regardless of the reading cumulative skills 
semester GPAs. 

In listening and speaking, the second and third cumulative skills semester GPAs are more 
predictive of DLPT performance than the first cumulative skills semester GPA in all of the 
models. Cumulative skills semester GPAs two and three are predictive of DLPT listening 
performance in the full model, and cumulative skills semester GPA two is predictive in the 
partial model. Cumulative skills semester GPA three is predictive of DLPT speaking 
performance in the full model, and cumulative skills semester GPAs one and two are predictive 
in the partial model. The tree in Figure 11 has an overall misclassification rate of 18%, Figure 12 
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has a misclassification rate of 18.3%, Figure 13 has an overall misclassification rate of 24.9%, 
and Figure 14 has an overall misclassification rate of 24.6%. 

Figure 11 shows that if an individual has a listening cumulative skills semester three 
GPA greater than 2.66, he or she has a 0.95 probability of getting a 2 on the listening portion of 
the DLPT. Taking into consideration just the first two semesters as shown in Figure 12, the 
student would need a listening cumulative skills semester two GPA greater than 2.93 to have a 
0.98 probability of getting a 2 on the DLPT. In speaking. Figure 13 shows that in order for a 
student to receive a 2 on the speaking portion of the DLPT, he or she would require a semester 
three cumulative skills GPA greater than 3.38 and a semester one cumulative skills GPA greater 
than 3.23 for the partial model. 
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Figure 12; Arabic DLPT.L and Listening Cumulative Skills GPA (Partial Model) 

















Figure 14: Arabic DLPT.S and Speaking Cumulative Skills GPA (Partial Model) 


Legend: 


Sample Size 


Cat 0%/Cat 1 %/Cat 1 % 

(less than Level 1, Level 1 or 1+, Level 2 or greater) 
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E. BEST OVERALL PREDICTOR OF DLPT PERFORMANCE 

As in the Persian Language Program, we would also like to identify what the overall best 
predictors of DLPT performance within the Arabic Language Program are, taking into account 
all three semester GPAs, all nine cumulative skills GPAs, and all of the C-Tests for all three 
skills. This answers the question: “Given everything we know academically about the student 
(listening, reading, and speaking C-Test grades, semester GPAs, and cumulative skills GPAs), 
what is the best predictor of DLPT performance?” Figure 15, a classification tree, answers this 
question. Each node contains the sample size used in the splitting of that node. Underneath each 
node are the classification percentages related to DLPT performance in the following manner: 
not obtaining at least a 2/2/1, obtaining either a 2/2/1 or 2/2/1+, or obtaining at least a 2/2/2. It 
identifies the second and third semester GPAs as being the most predictive. Figure 15 is almost 
exactly the same as Figure 10. This is quite surprising and counter-intuitive. The Arabic 
language program’s belief is that the cumulative skills semester GPAs are the best predictors of 
DLPT performance, and the cumulative skills semester GPAs are currently being subjectively 
used to predict DLPT performance as stated in Chapter I. The misclassification rate of this model 
is estimated to be 38.2%. 
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V. SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 


A. SUMMARY 

The focus of this thesis is threefold. First, we determine if major program tests, 
cumulative skills GPAs, or semester GPAs are predictive of DLPT performance in the Arabic 
and Persian language programs by determining the relationship between each major program test 
grade or semester GPA and the DLPT in listening, reading, and speaking. The relationship of 
cumulative skill semester GPAs to the DLPT is also explored. Secondly, we concentrate 
attention on sustained student performance across all three semesters and predictors of 
performance from test to test and semester to semester through the relationships among each of 
the major program tests, semester GPAs, and cumulative skills GPAs. Finally, we determine if 
individual program tests can be identified as having a strong relationship to DLPT performance 
as an aid to the language programs in recycling or dropping students. 

B. CONCLUSIONS 

The major program tests, known as phase tests in Persian and C-Tests in Arabic, are 
useful predictors of DLPT performance in the skills of listening, reading, and speaking. The 
major program tests independently assess these three skills as well. In addition, tests taken 
towards the latter half of the curriculum tend to be more predictive of DLPT performance than 
those of the first half. In the Persian analysis, phase tests five and six are selected as the most 
predictive in all three skills. However, phase tests one and two appear in the models as well. In 
the Arabic analysis, C-Tests eleven, twelve, fourteen, fifteen, and semester tests two and three 
appear in the models. C-Test eleven appears in four of the six models, and semester tests two 
and three appear in three of the six models, each. Tests taken earlier in the course do not appear 
in the tree models until the third or fourth level. 
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In contrast to program tests and cumulative skills GPAs, the semester GPA includes a 
variety of different grades and areas of study not strictly limited to the assessment of the three 
skill areas tested by the DLPT. Thus it was expected that the semester GPA would not be as 
useful as the program tests or cumulative skills GPAs. However, our analysis shows the value of 
the semester GPAs. For Persian, semester GPAs one and two are good indicators, and for 
Arabic, semester GPAs two and three are good indicators of DLPT performance. The 
misclassification rate of the classification trees for Persian is 26% and for Arabic 37%. Later, we 
again see the importance of the semester GPAs in determining the overall best predictors of 
DLPT performance. Semester GPAs are identified as being the best overall predictors of DLPT 
performance for both Persian and Arabic. 

Prior to our analysis, our intial belief was that the cumulative skills GPAs are the best 
predictors of DLPT performance. When used in a regression model with the DLPT scores in 
listening, reading, and speaking as the response variable for each skill, the cumulative skills 
GPAs prove themselves to be valuable tools. The cut-off GPAs provide the Arabic language 
program with an objective, versus subjective, instrument to forecast DLPT performance. 
Interestingly, the cumulative skills GPAs are not identified as the best overall predictors of DLPT 
performance as we had believed they would be. 

In trying to predict performance on a future test or GPA based on previous test or GPA 
performance, we find inconsistent results. For both Arabic and Persian program tests, it seems 
plausible to predict performance based on pairwise relationships of program tests. Many of the 
program tests have moderate to high correlations. However, the multiple regression analysis for 
the Persian phase tests provides little support that we can measure how well a student will do on 
future tests based on past test performance. Yet, for Arabic, there appears to be some credence in 
doing so. The inconsistency could be because the Arabic C-Tests are designed to address a 
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content and skill progression in their tests. Although Persian phase tests relate to the course 
content and a skill progression, they appear to do so to a lesser extent than Arabic. For both 
Persian and Arabic, we find previous semester GPAs and cumulative skills semester GPAs to be 
predictive of future GPAs. These results are supported by the vety high correlations between the 
GPAs. 

We use successive linear multiple regression to determine appropriate attrition points 
for students. Prior to our analysis, we believed the results of this analysis would mirror the 
Persian stepwise linear regression models and the Arabic regression tree models because a test 
identified as being predictive of DLPT performance could be argued to also be useful in 
determining when to drop a student. For Persian, the results of this model support the stepwise 
regression results. For Arabic, the results of this model do not support the results of the 
regression tree models. 

C. RECOMMENDATIONS 

I recommend that DLBFLC use the previously mentioned results and models to predict 
student performance in the Arabic and Persian language programs. Each of the models presented 
can also be used in similar analysis for other DLIFLC language programs. Additionally, I 
recommend that DLIFLC review the Arabic and Persian program tests for content and the testing 
of skill progression. This will ensure students are being exposed to questions specifically related 
to course material. More importantly, it will ensure students are exposed to questions that will 
increasingly assess their proficiency within the language and the three skills with each successive 
test. I also recommend that complete student records, including semester GPAs, program test 
raw scores, and cumulative skills GPAs, be retained for a period of at least two years to facilitate 
further analysis. 
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APPENDIX A. PERSIAN TEST NUMERICAL SUMMARIES 


Numerical summaries provide a statistical synopsis of the data. From Tables A. 1 
though A.4, it is obvious that for listening, phase tests one and five have the lowest standard 
deviation of the six. For reading, phase tests one, two, and four have the lowest standard 
deviation, and for speaking, phase tests four, five, and six have the lowest standard deviation of 
the six. Typically, tests with lower standard deviations are loaded on more heavily in the 
regression model. The sample size for each test is 233 students. Due to missing test scores, the 
sample size is reduced by the number included in the column labeled “Missing.” The “Missing” 
values are the same for the phase tests for each skill because these students are missing data for 
all the skill portions of those particular tests. 


Table A.l: Persian Listening Phase Test Numerical Summaries 



MIN 

MAX 

MEAN 

MEDUN 

MISSING 

STD DEV 

LPHASEl 

46.0 

100.0 

90.3 

91.5 

21 

7.87 

LPHASE2 

58.0 

100.0 

84.2 

86.0 

2 

10.1 

LPHASE3 

10.0 

100.0 

83.4 

84.0 

3 

12.7 

LPHASE4 

44.0 

100.0 

84.8 

86.0 

46 

11.2 

LPHASE5 

58.0 

100.0 

89.2 

91.0 

46 

7.94 

LPHASE6 

40.0 

100.0 

84,9 

86.0 

46 

10.3 


Table A.2: Persian Reading Phase Test Numerical Summaries 



MIN 

MAX 

MEAN 

MEDIAN 

MISSING 

STD DEV 

RPHASEl 

10.0 

100.0 

92.7 

94.0 

21 

8.38 

RPHASE2 

57.0 

100.0 

87.8 

88.0 

2 

8.13 

RPHASE3 

10.0 

100.0 

83.9 

86.0 

3 

11.9 

RPHASE4 

65.0 

100.0 

86.5 

86.0 

46 

8.05 

RPHASE5 

40.0 

100.0 

87.9 

90.0 

46 

10.4 

RPHASE6 

28.0 

100.0 

85.0 

85.0 

46 ! 

9.76 


Table A3; Persian Speaking Phase Test Numerical Summaries 



MIN 

MAX 

MEAN 

MEDIAN 

MISSING 

STD DEV 

SPHASEl 

63.0 

100.0 

92,9 

95.8 

21 

7.85 

SPHASE2 

68.0 

100.0 

91.3 

93.0 

2 

7.22 

SPHASE3 

68.0 

100.0 

93.0 

95.0 

3 

6.61 

SPHASE4 

68.0 

100.0 

93.4 

95.0 

46 

6.13 

SPHASE5 

72.0 

100.0 

92.5 n 

94.0 

46 

6.26 

SPHASE6 

74,0 

100.0 

93.5 

95.0 

46 

5.84 
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Table A.4: Persian GPA and Proficiency Numerical Summaries 



MIN 

MAX 

MEAN 

MEDIAN 

MISSING 

STD DEV 

DLPT.L 

23.0 

59.0 

45.2 

45.0 

0 

4.38 

DLPT.R 

24.0 

60.0 

45.8 

46.0 

0 

5.84 

DLPT.S 

10.0 

36.0 

20.6 

20.0 

0 

3.59 

SEMl.GPA 

1.60 

4.00 

3.21 

3.20 

2 

.479 

SEM2.GPA 

1.70 

4.00 

3.07 

3.10 ' 

0 

.529 

SEM3.GPA 

1.00 

4.00 

3.18 

3.20 

0 

.525 
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APPENDIX B. PERSIAN PAIRWISE CORRELATIONS 


The correlation matrix is a numerical summary used to understand the relationship of 
pairs of variables. We define the correlation to be low, moderate or high if the correlation 
coefficient meets the following criteria: low if coefficient is between 0.01 and 0.400, moderate if 
correlation coefficient is between 0.401 and 0.699, and high if the coefficient is between 0.700 
and 1.0. All moderate and high correlations are in bold. 


Table B.l: Persian DLPT-Program Test Correlations 



DLPT.L 

DLPT.R 

DLPT.S 

LPHASEl 

.305 

.186 

.365 

LPHASE2 

.471 

.311 

.426 

LPHASE3 

.296 

.125 

.338 

LPHASE4 

.422 

.233 

.392 

LPHASE5 

.466 

.343 

.484 

LPHASE6 

.546 

.378 

.489 

RPHASEl 

.144 

.193 

.154 

RPHASE2 

.303 

.250 

.425 

RPHASE3 

.184 

.186 

.359 

RPHASE4 

.294 

.184 

.361 

RPHASE5 

.400 

.421 

.479 

RPHASE6 

.442 

.443 

.467 

SPHASEl 

.297 

.227 

.248 

SPHASE2 

.351 

.305 

.334 

SPHASE3 

.282 

.226 

.398 

SPHASE4 

.271 

.175 

.368 

SPHASE5 

.331 

.247 

.353 

SPHASE6 

.402 

.334 

.459 


69 







































































Table B.2: Persian DLPT-Semester GPA Correlations 



SEMl.GPA 

SEM2.GPA 

SEM3.GPA 

DLPT.L 

.476 

366 

.477 

DLPT.R 

373 

.267 

.408 

DLPT.S 

.486 

.493 

361 


Table B,3: Persian Listening Phase Test-Phase Test Correlations 



LPHASEl 

LPHASE2 

LPHASE3 

LPHASE4 

LPHASE5 

LPHASE6 

LPHASEl 

1.000 

0.463 


0.306 

0.307 

0.400 

LPHASE2 

0.463 

1.000 

HI^S 

0.600 

0.498 

0.556 

LPHASE3 



1.000 

0.466 

0.365 

0.444 

LPHASE4 

0.306 

0.600 


1.000 

0.567 

0.649 

LPHASE5 

0.307 

0.498 

0.365 


1.000 

0.585 

LPHASE6 

0.400 


0.444 


0.585 

1.000 

RPHASEl 

0.175 

0.132 

0.091 

0.114 

0.118 

0.085 

RPHASE2 

0.392 

0.507 


0.400 

0.457 

0.502 

RPHASE3 

0.299 

0.294 


0.364 

0.329 

0.296 

RPHASE4 

0.225 

0.455 

0-375 


0.327 

0.422 

RPHASE5 

0.283 

0.402 

0.372 

0.504 

0.499 

0.579 

RPHASE6 

0.246 

0.402 

0.327 

0.367 

0.470 

0.521 

SPHASEl 

0.192 

0.309 

0.078 

0.086 

0.105 

0.155 

SPHASE2 

0.386 

0.446 

0.353 

0.340 

0.429 

0.394 

SPHASE3 

0.218 

0.361 

0.293 

0.273 

0.277 

0.234 

SPHASE4 

0.205 

0.368 

0.323 

0.344 

0.338 

0.326 

SPHASE5 

0.225 

0.396 

0.295 


0.449 

0.419 

SPHASE6 

0.238 

0.468 

0.354 



0.559 
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Table B.4: Persian Reading Phase Test-Phase Test Correlations 


1 RPHASEl 

RPHASE2 

RPHASE3 

RPHASE4 

RPHASE5 

RPHASE6 

LPHASEl 

0.175 

0.392 

0.299 

0.225 

0.283 

0.246 

LPHASE2 

0.132 

0.507 

0.294 

0.455 

0.402 

0,402 

LPHASE3 

0.091 

0.488 

0.500 

0.375 

0.372 

0.327 

LPHASE4 

0.114 

0.400 

0.364 


0.504 

0.367 

LPHASE5 

0.118 

0.457 

0.329 

0-327 

0.499 

0.470 

LPHASE6 

0.085 

0.502 

0.296 


0.579 0.521 

RPHASEl 

1.000 

0.179 

0.117 

0.213 

0.140 

0.189| 

RPHASE2 

0.179 

1.000 

0.375 


0.487 

mjjQgQi 

RPHASE3 

0.117 

0.375 

1.000 

0.318 

0.397 

0.360| 

RPHASE4 

0.213 

HBssa 

0.318 

1.000 

■CSI 


RPHASE5 

0.140 


0.397 

0,457 

1.000 

0.675 

RPHASE6 

0.189 

0.504 

0.360 

Wmm 

0.675 

1.000 

SPHASEl 

0.285 

0.270 

0.047 

0.311 

0.162 

0.170 

SPHASE2 

0.209 

0.553 

0.330 

MB) 

0.454 

Wmm\ 

SPHASE3 

0.257 

0.353 

0.334 


0.337 

0.313 

SPHASE4 

0.108 

0.383 

0.337 


0.422 

0.398 

SPHASE5 

0.145 

0.393 

0.268 


0.487 

0.399 

SPHASE6 

0.140 

■B 

0.265 

■B 

0.480 



Table B.5: Persian Speaking Phase Test-Phase Test Correlations 
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Table B.6: Persian Semester GPA Correlations 



SEMl.GPA 

SEM2.GPA 

SEM3.GPA 

SEMl.GPA 

1.000 

.708 

.706 

SEM2.GPA 

.708 

1.000 

.793 

SEM3.GPA 

.706 

.793 

1.000 
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APPENDIX C. PREDICT PERSIAN SUSTAINED STUDENT PERFORMANCE 


Table C.l: Predicting Sustained Performance on Persian Phase Tests 


Model 

RSE’^ 

d.oX * 

R' 

Tests with p-value < 0.05 

LISTENING 





(1) LPHASE6 - LPHASE5 + LPHASE4 + LPHASE3 
+ LPHASE2 + LPHASEl 

7.354 

159 

0.532 

LPHASEl, LPHASE4, 
LPHASE5 

(2) LPHASE5 - LPHASE4 + LPHASE3 + LPHASE2 
+LPHASEl 

6.399 

160 

0.367 

LPHASE2, LPHASE4 

(3) LPHASE4 - LPHASE3 + LPHASE2 + LPHASEl 

8.94 

161 

0.393 

LPHASE2, LPHASE3 

(4) LPHASE3 ~ LPHASE2 + LPHASEl 

10.46 

207 

0.338 

LPHASEl, LPHASE2 

(5) LPHASE2 - LPHASEl 

8.975 

209 

0.209 

LPHASEl 

READING 





(6) RPHASE6 - RPHASE5 + RPHASE4 + RPHASE3 
+ RPHASE2 + RPHASE1 

6.935 

159 

0.522 

RPHASE2, RPHASE4, 
RPHASE5 

(7) RPHASE5 - RPHASE4 + RPHASE3 + RPHASE2 
+ RPHASEl 

8.69 

160 

0.336 

RPHASE2, RPHASE3, 
RPHASE4 

(8) RPHASE4 - RPHASE3 + RPHASE2 + RPHASEl 

6.939 

161 

0.281 

RPHASE2, RPHASE3 

(9) RPHASE3 - RPHASE2 + RPHASEl 

11.07 

207 

0.162 

RPHASE2 

(10) RPHASE2 - RPHASEl 

8.052 

209 

0.047 

RPHASEl 

SPEAKING 





(11) SPHASE6 - SPHASE5 + SPHASE4 + SPHASE3 
+ SPHASE2 + SPHASEl 

4.501 

159 

0.373 

SPHASE3, SPHASE4, 
SPHASE5 

(12) SPHASE5 - SPHASE4 + SPHASE3 + SPHASE2 
+ SPHASEl 

4.745 

160 

0.417 

SPHASE2, SPHASE3, 
SPHASE4 

(13) SPHASE4 - SPHASE3 + SPHASE2 + SPHASEl 

4.671 

161 

0.251 

SPHASE3 

(14) SPHASE3 - SPHASE2 + SPHASEl 

5.108 

207 

0.420 

SPHASE2, SPHASE3 

(15) SPHASE2 ~ SPHASEl 

6.182 

209 

0.250 

SPHASEl 


*RSE: Residual Standard Error 
*d.o.f.: degrees of freedom 


Table C.2: Predicting Sustained Performance with Persian Semester GPAs 



Model 

RSE 

d.o.f. 

R^ 


(1) SEM3.GPA - SEM1 .GPA + SEM2.GPA 

0.295 

227 

0.684 

SEMl.GPA, SEM2.GPA 

(2) SEM2.GPA - SEMI.GPA 

0.380 

228 

0.485 

SEMI.GPA 
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APPENDIX D. PERSIAN SEMESTER GPA CROSSTABULATIONS 


The crosstabulations show semester GPA intervals, one GPA at a time, that correspond 
to attaining minimum DLPT scores. The categories are defined as follows: 2 - at least a 2/2/2,1 - 
either a 2/2/1 or 2/2/1+, 0 - not achieving at least a 2/2/1. The cell of each semester GPA interval 
contains the number of students falling within a particular GPA range and the percentage within 
that row. 


Table D.l: Persian DLPT and First Semester GPA Crosstabulations 


First Semester 

GPA Intervals 

Category 


0 (less than 2/2/1) 

1 (2/2/1 or 2/2/1+) 

2 (2/2/2 or better) 

1.0-2.8 

n 

16 

10 

12 

% 

.421 

.263 

.316 

2.8-2.9 

n 

10 

7 

11 

% 

.357 

.250 

.393 

2.9-3.0 

n 

0 

2 

10 

% 


.167 

.833 

3.0-3.2 

n 

5 

3 

33 

% 

.122 

.073 

.805 

3.2-3.5 

n 

4 

3 

40 

% 

.085 

.064 

.851 

3.5-3.7 

n 

4 

4 

25 

% 

.121 

.121 

.758 

o 

1 

n 

4 

0 

27 

% 

.129 


.871 

1 Column Totals 

43 

29 

158 


J_I-L 



2.2 - 

1.7 - 


-|- 1 -^ 

0 1 2 
C ATEG O RY 


Figure 16: Persian Boxplot of Category versus First Semester GPA 
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Table D3: Persian DLPT and Third Semester GPA Crosstabulations 


Third Semester 

GPA Intervals 

Category 


0 (less than 2/2/1) 

1 (2/2/1 or 2/2/1+) 

2 (2/2/2 or better) 

1.5-2.3 

n 

4 

3 

3 

% 

.400 

.300 

.300 

2.3-2.8 

n 

12 

7 

18 

% 

.514 

.189 

.487 

2.8-2.9 

n 

10 

1 

8 

% 

.526 

.053 

.421 

2.9-3.0 

n 

4 

6 

6 

% 

.250 

.375 

.375 

3.0-3.2 

n 

6 

6 

26 

% 

.158 

.158 

.684 

3.2-3.5 

n 

6 

5 

43 

% 

.111 

.093 

.796 

3.5-3.7 

n 

1 

1 

20 

% 

.046 

.046 

.910 

3.7-4.0 

n 

1 

0 

34 

% 

.029 


.971 

1 Column Totals 

44 

29 

158 



CATEG O RY 

Figure 18: Persian Boxplot of Category versus Third Semester GPA 
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APPENDIX E. IDENTIFYING POTENTIAL DECISION POINTS FOR PERSIAN 
ATTRITION BASED ON MAJOR PROGRAM TESTS 

Particular tests should be looked at more carefully before a decision is made to drop a 


student. To identify an appropriate point for recycling or dropping students, multiple linear 
regression is used to determine if there is a critical program test with a significant F-statistic and 
change in rI The simple model is the DLPT test regressed against the first phase test. Further 
models are formed by sequentially adding successive phase tests to the initial model. 


Table E.1: Identifying Potential Decision Points For Persian Attrition 


Model 

RSE 

d.o.f. 

ClHil 

iti.M.mi'.inl 

LISTENING 





DLPT.L -- LPHASEl 

4.10 

209 

0.112 

0.112 

DLPT.L - LPHASEl + LPHASE2 

3.73 

208 

0.266 

0.154 

DLPT.L - LPHASEl + LPHASE2 + LPHASE3 

3.71 

206 

0.269 

0.003 

DLPT.L - LPHASEl + LPHASE2 + LPHASE3 + 
LPHASE4 

3.61 

160 

0.262 

-0.007 

DLPT.L ~ LPHASEl + LPHASE2 + LPHASE3 + 
LPHASE4 + LPHASE5 

3.52 

159 

0.302 

0.040 

DLPT.L - LPHASEl + LPHASE2 + LPHASE3 + 
LPHASE4 + LPHASE5 + LPHASE6 

3.40 

158 

0.353 

0.051 

READING 





DLPT.R - RPHASEl 

5.56 

209 

0.074 

0.074 

DLPT.R - RPHASEl + RPHASE2 

5.39 

208 

0.135 

0.061 

DLPT.R - RPHASEl + RPHASE2 + RPHASE3 

5.30 

206 

0.158 

0.023 

DLPT.R - RPHASEl + RPHASE2 + RPHASE3 + 
RPHASE4 

5.42 

160 

0.094 

-0.064 

DLPT.R - RPHASEl + RPHASE2 + RPHASE3 + 
RPHASE4 + RPHASE5 

5.11 

159 

0.199 

0.105 

DLPT.R - RPHASEl + RPHASE2 + RPHASE3 + | 
RPHASE4 + RPHASE5 + RPHASE6 

4.99 

158 

0.242 

0.043 

SPEAKING 





DLPT.S - SPHASEl 

3.55 

209 

0.064 

0.064 

DLPT.S - SPHASEl + SPHASE2 

3.45 

208 

0.122 

0.058 

DLPT.S - SPHASEl + SPHASE2 + SPHASE3 

3.33 

206 

0.192 

0.070 

DLPT.S - SPHASEl + SPHASE2 + SPHASE3 + 
SPHASE4 

3.28 

160 

0.222 

0.030 

DLPT.S - SPHASEl + SPHASE2 + SPHASE3 + 
SPHASE4 + SPHASE5 

3.28 

159 

0.227 

0.005 

DLPT.S - SPHASEl + SPHASE2 + SPHASE3 + 
SPHASE4 + SPHASE5 + SPHASE6 

3.17 , 

158 

0.284 

0.057 
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APPENDIX F. PERSIAN S-PLUS LOGISTIC REGRESSION RESULTS 


LOGISTIC REGRESSION SUB-MODEL (1) 

Call: glm(formula = Y1 ~ SEMLGPA + SEM2,GPA + SEM3.GPA, 
family = binomial, data = progdlpt, na.action 
= na.omit, control = list(epsilon = 0.001, 
maxit = 50, trace = F)) 

Deviance Residuals: 


Min IQ 

Median 3Q 

Max 

-2.48 0.305 

0.455 

0.621 

1.57 

Coefficients: 

Value 

Std. Error 

t value 

(Intercept) 

-4.72 

1.32 

-3.58 

SEMl.GPA 

1.34 

0.508 

2.65 

SEM2.GPA 

-0.920 

0.614 

-1.50 

SEM3.GPA 

1.56 

0.584 

2.66 


(Dispersion Parameter for Binomial family taken to be 1 ) 
Null Deviance: 222.0 on 230 degrees of freedom 
Residual Deviance: 191.8 on 227 degrees of freedom 
Number of Fisher Scoring Iterations: 4 


LOGISTIC REGRESSION SUB-MODEL (2) 

Call: glm(formula = Z1 - SEMl.GPA + SEM2.GPA + SEM3.GPA, 
family = binomial, data = progdlpt, na.action 
= na.omit, control = list{epsilon = 0.001, 
maxit = 50, trace = F)) 

Deviance Residuals: 

Min IQ Median 3Q Max 

-2.48 0.255 0.418 0.602 1.54 


Coefficients: 

Value 

Std. Error 

t value 

(Intercept) 

-5.84 

1.73 

-3.36 

SEMl.GPA 

1.48 

0.735 

2.01 

SEM2.GPA 

0.561 

0.692 

0.810 

SEM3.GPA 

0.384 

0.757 

0.507 


(Dispersion Parameter for Binomial family taken to be 1) 
Null Deviance: 161.7 on 187 degrees of freedom 
Residual Deviance: 139.6 on 184 degrees of freedom 
Number of Fisher Scoring Iterations: 4 
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APPENDIX G. ARABIC TEST NUMERICAL SUMMARIES 


The original sample size for each test is 409 students. Due to missing test scores, the 
sample size is reduced by the number included in the column labeled “MISSING.” 


Table G.l: Arabic Listening C-Test Numerical Summaries 



MIN 

MEAN 

MEDIAN 

MAX 

MISSING 

STD DEV 

LC01.NUM 


2.96 

3.00 

4.00 

75.0 

0.890 

LC02.NUM 

0.700 

2.60 

2.70 

4.00 

19.0 

0.869 

LC03.NUM 

0.700 

2.22 

2.30 

4.00 

50.0 

0.867 

LC04.NUM 

0.000 

2.54 

2.70 

4.00 

29.0 

0.884 

LC05.NUM 

0.700 

2.51 

2.30 

4.00 

41.0 

0.858 

LC06.NUM 

0.700 

2.58 

2.30 

4.00 

49.0 

0.848 

LC07.NUM 

0.700 

2.67 

2.70 

4.00 

64.0 

0.748 

LS01.NUM 

0.700 

2.38 

2.30 

4.00 

65.0 

0.991 

LC08.NUM 

0.700 

2.54 

2.30 

4.00 

127.0 

0.683 

LC09.NUM 

0.700 

2.48 

2.50 

4.00 

77.0 

0.812 

LC10.NUM 

0.700 

2.87 

2.85 

4.00 

79.0 

0.775 

LC11.NUM 

0.700 

2.35 

2.30 

4.00 

82.0 

0.811 

LC12.NUM 

0.700 

2.91 

3.00 

4.00 

86.0 

0.715 

LS02.NUM 

0.700 

2.69 

2.70 

4.00' 

134.0 

0.764 

LC13.NUM 

1.00 

2.63 

2.70 

4.00 

92.0 

0.706 

LC14.NUM 

0.700 

2.64 

2.70 

4.00 

97.0 

0.841 

LC15.NUM 

0.700 

2.85 

3.00 

4.00 

136.0 

0.823 

LS03.NUM 

0.700 

' 2.54 

2.70 

4.00 

173.0 

0.874 
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Table G.2: Arabic Reading C-Test Numerical Summaries 



MIN 

MEAN 

MEDIAN 

MAX 

MISSING 

STD DEV 

RC01.NUM 

0.700 

2.99 

3.30 

4.00 

75.0 

0.901 

RC02.NUM 

0.700 

2.70 

2.70 

4.00 

19.0 

0.924 

RC03.NUM 

0.700 

2.57 

2.70 

4.00 

50.0 

0.992 

RC04.NUM 

0.700 

2.85 

3.00 

4.00 

30.0 

0.918 

RC05.NUM 

0.700 

2.75 

2.70 

4.00 

41.0 

0.823 

RC06.NUM 

0.700 

2.66 

2.70 

4.00 

49.0 

0.777 

RC07.NUM 

0.700 

2.62 

2.70 

4.00 

64.0 

0.855 

RSOl.NUM 

0.700 

2.68 

3-00 

4.00 


0.923 

RC08.NUM 

1.70 

2.77 

2.70 

4.00 

127.0 

0.631 

RC09.NUM 

0.700 

2.65 

2.70 

4.00 

77.0 

0.933 

RC10.NUM 

0.700 

2.74 

2.70 

4.00 

79.0 

0.732 

RCILNUM 

0.700 

2.72 

2.70 

4.00 

82.0 

0.764 

RC12.NUM 

0.700 

2.84 

3.00 

4.00 

86.0 

0.778 

RS02.NUM 

0.700 

3.04 

3.00 

4.00 

134.0 

0.686 

RC13.NUM 

0.700 

2.92 

3.00 

4.00 

92.0 

0.808 

RC14.NUM 

0.700 

2.80 

3.00 

4.00 

97.0 

0.869 

RC15.NUM 

1.00 

2.96 

3.00 

4.00 

136.0 

0.782 

RS03.NUM 

1.00 

3.21 

3.30 

4.00 

173.0 

0.729 


Table G3: Arabic Speaking C-Test Numerical Summaries 



MIN 

MEAN 

MEDIAN 

MAX 

MISSING 

STD DEV 

SC01.NUM 


2.68 

3.00 

4.00 

73.0 

0.711 

SC02.NUM 

0.700 

2.65 

3.00 

4.00 

19.0 

0.686 

SC03.NUM 

0.700 

2.62 

2.70 

4.00 

79.0 

0.719 

SC04.NUM 

0.700 

2.66 

2.70 

3.70 

30.0 

0.697 

SC05.NUM 

0.700 

2.42 

2.70 

4.00 

41.0 

0.964 

SC06.NUM 

1.30 

2.72 

2.70 

4.00 

50.0 

0.611 

SC07.NUM 

1.30 

2.79 

3.00 

4.00 

91.0 

0.560 

SSOl.NUM 

1.30 

2.84 

3.00 

4.00 

65.0 

0.543 

SC08.NUM 

1.30 

2.76 

3.00 

4.00 

127.0 

0-566 

SC09.NUM 

1.70 

2.83 

3.00 

4.00 

77.0 

0-541 

SCIO.NUM 

0.700 

2.79 

3.00 

4.00 

79.0 

0.587 

SC11.NUM 

1.30 

2.81 

3.00 

4.00 

82.0 

0.552 

SCI2.NUM 

1.30 

2.84 

3.00 

mg 

86.0 

0.566 

SS02.NUM 

1.30 

2.91 

3.00 


134.0 

0.536 

SC13.NLM 

1.00 

2.82 

3.00 

4.00 

92.0 

0.568 

SC14.NUM 

1.30 

2.85 

3.00 

4.00 

97.0 

0.579 

SC15.NUM 

1.30 

2.96 

3.00 

4.00 

136.0 

0.545 

SS03.NUM 

1.00 

2 . 93 ; 

3.00 

4.00 

173.0 

0.567 
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Table G.4: Arabic GPA Numerical Summaries 



MIN 

MEAN 

MEDIAN 

MAX 

MISSING 

STD DEV 

SEMl.GPA 

LOO 

2.67 

2.70 

4.00 

41.0 

0.577 

SEM2.GPA 

L50 

2.77 

2.80 

3-90 

77.0 

0.513 

SEM3.GPA 

1.40 

2.93 

2.90 

4.00 

88.0 

0.531 

LCSKl.GPA 

1.32 

2.54 

2.47 

4.00 

120.0 

0.623 

LCSK2.GPA 

1.18 

2.66 

2.65 

3.87 

135.0 

0.626 

LCSK3.GPA 

1.10 

2.61 

2.62 

4.00 

174.0 

0.699 

RCSKl.GPA 

1.11 

2.77 

2.74 

4.00 

120.0 

0.639 

RCSK2.GPA 

1.16 

2.90 

2.95 

4.00 

135.0 

0.560 

RCSK3.GPA 

1.12 

3.04 

3.07 

4.00 

174.0 

0.638 

SCSKl.GPA 

1.61i 

2.78 

2.78 

3.85 

120.0 

0.466 

SCSK2.GPA 

1.55 

2.87 

2.90 

3.94 

135.0 

0.471 

SCSK3.GPA 

1.38 

2.89 

2.95 

4.00 

174.0 

0-501 


Table G^: Arabic DLPT Numerical Summaries 



MIN 

MEAN 

MEDIAN 

MAX 

MISSING 

STD DEV 

DLPTX 

4.00 

43.1 

43.0 

59.0 

90.0 

5.86 

DLPT.R 

36.0 

46.0 

45.0 

60,0 

90.0 

4.20 

DLPT.S 

6.00 

16.5 

16.0 

26.0 

90.0 

3.85 
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APPENDIX H. ARABIC PAIRWISE CORRELATIONS 


We define the correlation to be low, moderate or high if the correlation coefficient meets 
the following criteria: low if coefficient is between 0.01 and 0.400, moderate if correlation 
coefficient is between 0.401 and 0.699, and high if the coefficient is between 0.700 and 1.0. All 
correlations above 0.500 are in bold. 


Table H.l: Arabic DLPT-DLPT Correlations 



DLPTX 

DLPT.R 

DLPT.S 

DLPTX 

1.000 

0.660 

0.443 

DLPT.R 

0.660 

1.000 

0.445 

DLPT.S 

0.443 

0.445 

1.000 


Table H.2: Arabic DLPT and Listening C-Test Correlations 



DLPT.L 

DLPT.R 

DLPT.S 

LCOl 

0.172 

0.198 

0.190 

LC02 

0.290 

0.285 

0.220 

LC03 

0.338 

0.317 

0.333 

LC04 

0.397 

0.334 

0.346 

LC05 

0.423 

0.426 

0.388 

LC06 

0.390 

0.425 

0.404 

LC07 

0.414 

0.338 

0.379 

LSOl 

0.496 

0.456 

0.476 

LC08 

0.511 

0.431 

0.420 

LC09 

0.454 

0.457 

0.469 

LCIO 

0.514 

0326 

0.477 

LCll 

0.603 

0384 

0.485 

LC12 

0.470 

0.384 

0.448 

LS02 

0331 

0.547 

0311 

LC13 

0328 

0.555 

0.409 

LC14 

0.507 

0316 

0.391 

LC15 

0363 

0.549 

0.483 

LS03 

0334 

0.488 

0.416 
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Table H.3: Arabic DLPT and Reading C-Test Correlations 



Table H.4: Arabic DLPT and Speaking C-Test Correlations 
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Table H.5: Arabic DLPT and Semester GPA Correlations 



DLPTX 

DLPT.R 

DLPT.S 

SEMl.GPA 

0^50 

0551 

0.502 

SEM2.GPA 

0.622 

0.659 

0.594 

SEM3.GPA 


0.679 

0.538 


Table H.6: Arabic DLPT and Cumulative Skills GPA Correlations 



DLPT.L 

DLPT.R 

DLPT.S 

LCSKl.GPA 


0519 

0520 

LCSK2.GPA 

0.628 


0587 

LCSK3.GPA 



0.499 

RCSKl.GPA 

0.459 

0.560 

0.415 

RCSK2.GPA 

0.476 

0582 

0.382 

RCSK3.GPA 

0587 

0.676 

0.435 

SCSKl.GPA 

0.357 

0.316 

0.381 

SCSK2.GPA 

0.447 

0.412 

0507 

SCSK3.GPA 

0.494 

0.512 

0.501 
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Table H.7.1: Arabic Listening C-Test Correlations 



LCOl 

LCOl 

LC03 

LC04 

LC05 

LC06 

LC07 

LSOl 

LCOl 

1.00 

0.48 

0.44 

0.39 

0.22 

0-27 

0.33 

0.31 

LC02 

0.48 

1.00 

0.51 

0.53 

0.48 

0.43 

0.37 

0.40 

LC03 

0.44 

0.51 

1.00 

0.55 

0.41 

0.49 

0.37 

0.31 

LC04 

0.39 

0.53 

0.55 

1.00 

0.51 

0.54 

0.49 

0.51 

LC05 

0.22 

0.48 

0.41 

0.51 

1.00 

0.63 

0.50 

0.35 

LC06 

0.27 

0.43 

0.49 

0.54 

0.63 


0.53 

0.37 

LC07 

0.33 

0.37 

0.37 

0.49 

0.50 


LOO 

0.44 

LSOl 

0.31 

0.40 

0.31 

0.51 

0.35 

0.37 

0.44 

1.00 

LC08 

0.29 

0.41 

0.36 

0.49 

0.55 

0-47 

0.52 

0.40 

LC09 

0.32 

0.39 

0.35 

0.44 

0.50 

0.48 

0.46 

0.47 

LCIO 

0.29 

0.41 

0.42 

0.46 

0.51 

0.54 

0.46 

0.49 

LCll 

0.27 

0.39 

0.37 

0.50 

0.47 

0.50 

: 0.49 


LC12 

0.15 

0.30 

0.35 

0.36 

0-36 

0.47 

0.45 

0.39 

LS02 

0.24 

0.36 

0.33 

0.43 

0.41 

0.41 

0.39 

0.61 

LC13 

0.21 

0.35 

0.35 

0.47 

0.50 

0.51 

0.43 

0.43 

LC14 

! 0.15 

0.32 

0.27 

0.39 

0.44 

0.44 

0.32 

0.40 

LC15 

; 0.21 

0.25 

0.25 

0.41 

0.46 

0.39 

0.41 

0.54 

LS03 

0.26 

0.25 

0.18 

0.34 

0.31 

0.37 

0.33 


RCOl 

0.35 

0.28 

0.28 

0.30 

0.11 

1 0.16 

0.21 

0.18 

RC02 

0.40 

0.48 

0.42 

0.40 

0.26 

1 0.27 

0.33 

0.41 

RC03 

0.32 

0.42 


0.40 

0.29 

0.34 

0.25 

0-14 

RC04 

0.26 

0.43 

0.46 

0.60 

0.53 

0.48 

0.43 

0.39 

RC05 

0.21 

0.34 

0.40 

0.45 

0.59 

0.49 

0.41 

0.36 

RC06 

0.24 

0.36 

0.41 

0.50 

0.59 

0.47 

0.47 

0.32 

RC07 

0.20 

0.35 

0.38 

0.44 

0.56 

0.56 

0.54 

0.49 

RSOl 

0.21 

0.33 

0.28 

0.45 

0.41 

0.42 

0.35 

0.66 

RC08 

0.18 

0.29 

0.28 

0.37 

0.43 

0-42 

0.39 

0-36 

RC09 

0.22 

0.29 

0.28 

0,36 

0.41 

0.42 

0.39 

0.38 

RCIO 

0.23 

0.28 

0-33 

0.39 

0.46 

0-45 

0.41 

0.44 

RCll 

0.18 

0.32 

0.34 

0.37 

0.43 

0.42 

0.44 


RC12 

0.15 

0.29 

0.31 

0.41 

0.48 

0.44 

0.40 

0.47 

RS02 

0.19 

0.17 

0.08 

0.26 

0.20 

0.13 

0.24 

0.36 

RC13 

0.11 

0.29 

0.29 

0.40 

0.39 

0.41 

0.34 

0.40 

RC14 

0.08 

0.21 

0.24 

0.29 

0.36 

0.38 

0.35 

0.29 

RC15 

0.15 

0.28 

0-29 

0.28 

0.32 

0.34 

0.31 

0.49 

RS03 

0.16 

0.17 

0.16 

0.24 

0.26 

0.24 

0.29 

0.51 

SCOl 1 

0.25 

0.24 

0.35 

0.29 

0.26 

0.22 

0.30 

0.09 

SC02 

0.33 


0.42 

0.32 

0.30 

0.33 

0.30 

0.08 

SC03 

0.29 

EEDH 

0.48 

0.30 

0.22 

0.28 

0.35 

0.00 

SC04 

0.28 

0.36 

0.42 

0.45 

0.35 1 

0.39 

0.33 

0.17 

SC05 

0.26 

0.29 

0.37 

0.37 

0.46 

0.42 

0.41 

0.18 

SC06 

0.23 

0.26 

0.35 

0.35 

0.35 

0.39 

0.40 

0.26 

SC07 

Ell^H 

0.37 

lESH 

0.43 

0.53 

0.47 

0.53 

0-37 

SSOl 

ebh 

0.36 

lEzai 

0.42 

0.50 

0.46 

0.53 

0.30 

SC08 

0.34 

lEB 

0.43 

0.45 

0.53 

0.46 

0.50 

0.37 

SC09 

0.25 

lESH 

0.36 

0.34 

0.33 

0.36 

0.38 

0.34 1 

SCIO 


0.31 

0.35 

0.35 

0.38 

0.37 

0.40 

0.39 

sen 


0.36 

0.39 

0.35 

0.42 

0.38 

0.43 

0.37 

SC12 

0.24 

0.38 

0.33 

iiiua 

0.47 

0.41 

0.49 

0.49 

SS02 

0.19 

0.35 

IEEH 

lEim 

0-39 

0.35 

0-43 

0.39 

SC13 

0.19 

0.35 

WSM 

0.34 

0.42 

0.44 

0-47 

0.44 

SC14 

OSi 

0.29 

0.25 

0.31 

0-40 

0.38 

0.46 

0.41 

SC15 


0.28 

0.25 

0-30 

0.40 

0.43 

0.43 

0.36 

SS03 

1 0.17 

0.25 

0.28 

0.31 

0.37 

0.36 

0.35 

0.39 
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Table H.7.2: Arabic Listening C-Test Correlations 
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Table H.8.1: Arabic Reading C-Test Correlations 



RCOl 

RC02 

RC03 

RC04 

RC05 

RC06 

RC07 

RSOl 

LCOl 

0.35 

0.40 

0.32 

0.26 

0.21 

0.24 

0.20 

0.21 

LC02 

0.28 

0.48 

0.42 

0.43 

0.34 

0.36 

0.35 

0.33 

LC03 

0.28 

0.42 

053 

0-46 

0.40 

0.41 

0.38 

0.28 

LC04 

0.30 

0.40 

0.40 

0.60 

0.45 

0.50 

0.44 

0.45 

LC05 

0.11 

0.26 

0.29 

053 

059 

059 

0.56 

0.41 

LC06 

0.16 

0.27 

0.34 

0.48 

0.49 

0.47 

0.56 

0.42 

LC07 

0.21 

0.33 

0.25 

0.43 

0.41 

0.47 

0.54 

0.35 

LSOl 

0.18 

0.41 

0.14 

0.39 

0.36 

0.32 

0.49 

0.66 

LC08 

0.21 

0.30 

0-26 

0-40 

0.36 

0.49 

0.43 

0.34 

LC09 

0.20 

0.35 

0.26 

0.40 

0.46 

0.45 

052 

0.49 

LCIO 

0.16 

0.36 

0.33 

0.40 

0.47 

0.47 

051 

0.47 

LCll 

0.14 

0.35 

0.27 

0.45 

0.41 

0.49 

055 


LC12 

0.08 

0.22 

0.23 

0.28 

0.33 

0.34 

0.45 

0.32 

LS02 

0.26 

0.41 

0.18 

0.37 

0.36 

0.38 

0.54 

058 

LC13 

0.08 

0.25 

0.22 

0.40 

0.39 

0.43 

0.46 

0.34 

LC14 

0.10 

0.18 

0.24 

0.39 

0.34 

0.40 

0.41 

0.41 

LC15 

0.10 

0.22 

0.11 

0.35 

0.31 

0.41 

0.42 

0.47 

LS03 

0.09 

0.25 

0.07 

0.32 

0.34 

0.36 

0.45 

0.48 

RCOl 

1.00 

0.57 

0.45 

0.35 

0.23 

0.24 

0.25 

0.20 

RC02 

057 

1.00 

055 

0.49 

0.43 

0.42 

0.48 

0.44 

RC03 

0.45 

055 

1.00 

052 

0.43 

0.46 

0.40 

0.21 

RC04 

0.35 

0.49 

052 

1.00 

0.65 

0.61 

0.57 

051 

RC05 

0.23 

0.43 

0.43 

0.65 

1.00 

0.64 

0.60 

0.47 

RC06 

0.24 

0.42 

0.46 

0.61 

0.64 

1.00 

0.65 

0.48 

RC07 

0.25 

0.48 

0.40 

0.57 

0.60 

0.65 

1.00 

058 

RSOl 

0.20 

0.44 

0.21 

051 

0.47 

0.48 

0.58 

1.00 

RC08 

0-26 

0.42 

0.36 

053 

0.49 

0.60 

0.61 

0.50 

RC09 

0.22 

0.38 

0.35 

0.48 

0.48 

057 

0.55 

0.47 

RCIO 

0.22 

0.48 

0.41 

0.41 

053 

0.57 

0.64 

0.48 

RCll 

0.19 

0.47 

0.34 

0.46 

0.45 

056 

0.61 

053 

RC12 

0.20 

0.41 

0.36 

051 

053 

055 

056 

0.51 

RS02 

0.08 

0.29 

0.15 

0.35 

0.28 

0.23 

0.33 

0.40 

RC13 

0.10 

0.30 

0.32 

0.45 

0.40 

0.49 

053 

0.46 

RC14 

0.11 

0.36 

0.35 

0.40 

0.44 

051 

0.49 

0.33 

RC15 

0.14 

0.40 

0.22 

0.39 

0.38 1 

0.42 

051 

056 

RS03 

0.12 

0.31 

0.09 

0-30 

0.26 

0.28 

0.41 

0.49 

SCOl 

0.33 

0.35 

0.32 

0.30 

0.30 

0.27 

0.37 

0.15 

SC02 

0.42 

0.42 

0.40 

0.33 

0.29 

0.28 

0.27 

0.13 

SC03 

0.32 

0.32 

0.42 

0.26 

0.25 

0.30 

0.23 

0.03 

SC04 

0.31 

0.37 

0.44 

0.47 

0.37 

0.45 

0.40 

0.23 

SC05 

0.25 

0.37 

0.27 

0.48 

0.46 

IliBH 

0.46 

0.24 

SC06 

0.24 

0.22 

0.23 

0-39 

0.34 


0.38 

0.20 

SC07 

0.18 

0.26 

0.34 

0.48 

0.44 

0.48 

0.49 

0.34 

SSOl 

0.19 

0.30 

0.37 

0.43 

0.42 

0.43 

050 

0.29 

SC08 

0.22 

0.35 

0.34 

0.39 

0.41 

0.43 

0.45 

0.30 

SC09 

0.16 

0.32 

0.24 

0.33 

0.32 

0.38 

0.35 

0.32 

SCIO 

0.07 

0.26 

0.18 

0-30 

0.31 

0.35 

0.34 

0.36 

sen 

0.09 

0.29 

0.28 

0.33 

0.39 

0.42 

0.40 

0.38 

SC12 

0.15 

0.39 

0.27 

0.43 

0.44 

0.40 

051 

0.44 

SS02 

0.08 

0.27 


0.39 

0.42 

0.38 

0.42 

0.34 

SC13 

0.04 

0.26 

Ili&EB 

0.35 

0.37 

0.36 

0.44 

0.40 

SC14 

0.05 

0.30 

0.24 

0.37 

0.37 

0.38 

0.45 

0.35 

SC15 

0.07 

0.26 

0.28 

0.37 

0.39 

0.41 

0.44 

0.33 

SS03 

0.14 

0-28 

0.22 

0.38 

0.38 

0.38 

0.45 

0.32 
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Table H.8.2: Arabic Reading C-Test Correlations 
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Table H.9.1: Arabic Speaking C-Test Correlations 



LCOl 

0.25 

0.33 

0.29 

0.28 

LC02 

0.24 

0.37 

0.31 

0.36 

LC03 

0.35 

0.42 

0.48 

0.42 

LC04 

0.29 

0.32 

1 0.30 

0.45 

LC05 

0.26 

0-30 

1 0.22 

0.35 

LC06 

0.22 

0.33 

i 0.28 

0.39 

LC07 

0.30 

0.30 

0.35 

0.33 

LSOl 

0.09 

0.08 

0.00 

0.17 

LC08 

0.17 

0.27 

0.24 

0.37 

LC09 

0.14 

0.16 

0.18 

0.25 

LCIO 

0.16 

0.24 

0.16 

0.29 

LCll 

0.26 

0.25 

0.22 

1 0.34 

LC12 

0.25 

0.17 

0.23 

i 0.24 

LS02 

0.16 

0.20 

0.18 

0.24 

LC13 

0.20 

0.24 

0.16 

0.26 

LC14 

0.15 

0.12 

0.11 

0.21 

LC15 

0.09 

0.15 

0.10 

0.20 

LS03 

0.08 

0.05 

0.08 

0.20 

RCOl 

0.33 

0.42 

0.32 

0.31 

RC02 

0.35 

0.42 

0.32 

0.37 

RC03 

0.32 

0.40 

0.42 

0.44 

RC04 

0.30 

0.33 

0.26 

0.47 

RC05 

0.30 

0.29 

0.25 

0.37 

RC06 

0-27 

0.28 

0.30 

0.45 

RC07 

0.37 

0.27 

0.23 

0.40 

RSOl 

0.15 

0.13 

0.03 

0.23 

RC08 

0.27 

0.20 

0.18 

0.40 

RC09 

0.17 

0.19 

0.21 

0.32 

RCIO 

0.25 

0.27 

0.15 

0.34 

RCll 

0.20 

0.25 

0.16 

0.25 

RC12 

0.28 

0.25 

0.16 

0.34 

RS02 

0.11 

0.07 

0.07 

0.06 1 

RC13 

0.19 

0.18 

0.16 

0.24 i 

RC14 

0.24 

0.16 i 

0.19 

0.26 

RC15 

0.20 

0.12 

0.12 

0.26 

RS03 

0.11 

0.05 1 

-0.01 

0.09 

SCOl 

1.00 

0.61 

0.48 

0.51 

SC02 

0.61 

1.00 

0.59 

0.57 

SC03 

0.48 


1.00 

030 

SC04 

0.51 


0.50 

1.00 

SC05 

0.48 

1 0.53 

0.42 

0.55 

SC06 

0.45 

■ESHI 

0.42 

030 

SC07 



0.39 1 

031 

SSOl 


0.40 

0-42 1 

0.49 

SC08 

0.32 

0.40 

0.39 

0-48 

SC09 

0.30 

0.28 


0.46 

SCIO 

0.24 

0.27 


0.34 

sen 

0.30 

0.27 

0.36 

0.46 

SC12 

0.28 

0.27 

0.30 

0.38 

SS02 

0.23 

0.25 

0.28 

0.38 

SC13 

0-15 

0.22 

0.21 

0.31 

SC14 

0.24 

0.24 

0.22 

0.41 

SC15 

0.23 

0.24 

0.24 

0.39 

SS03 

0.25 

0.23 

0.20 

0.40 


iwmmwt 












































































































































































































































































































































































































































































Table H.9.2: Arabic Speaking C-Test Correlations 

~SC08 SC09 SC10~~ sen ' SC12 SS02 SC13 SC14 SC15 SS03 
LCOl 0.34 0.25 0.20 0.28 0.24 0.19 0.19 0.16 0.20 0.17 

LC02 0.42 0.31 0.31 0.36 0.38 0.35 0.35 0.29 0.28 0.25 

LC03 0.43 0.36 0.35 0.39 0.33 0.30 0.27 0.25 0.25 0.28 

LC04 0.45 0.34 0.35 0.35 0.35 0.35 0.34 0.31 0.30 0.31 

LC05 0^3 0.33 0.38 0.42 0.47 0.39 0.42 0.40 0.40 0.37 

LC06 0.46 0.36 0.37 0.38 0.41 0.35 0.44 0.38 0.43 0.36 

LC07 0^0 0.38 0.40 0.43 0.49 0.43 0.47 0.46 0.43 0.35 

LSOl 0.37 0.34 0.39 0.37 0.49 0.39 0.44 0.41 0.36 0.39 

LC08 0.47 0.44 0.41 0.40 0.43 0.44 0.38 . 0.43 0.44 0.40 

LC09 0.43 0.44 0.50 0-46 0.53 0.49 0.56 0.55 0.49 0.54 

LCIO 0.43 0.35 0.46 0.43 0.49 0.46 0^0 0^2 0^3 0.52 

LCll 0.46 0.44 032 0.49 0^2 0^1 0^0 0.55 0.50 0.51 

LC12 0.39 0.43 0.45 0.42 0.38 0.42 0.43 0.46 0.47 0.47 

LS02 0.37 0.36 0.44 0.40 0.48 0.44 0.46 0.48 0.47 0.47 

LC13 0.38 0.35 0.42 0.43 0.40 0.44 0^1 0J3 0^2 0.54 

LC14 0.32 0.35 0.38 0.43 0.43 0.45 0^0 0.52 0.54 0.56 

LC15 ~a37 0.34 0.42 0.38 0.42 0.39 0.38 0.43 0.47 0.45 

LS03 0.26 0.33 0.32 0.34 0.36 0.37 0.38 0.39 0.44 0.44 

RCOl 0.22 0.16 0.07 0.09 0.15 0.08 0.04 0.05 0.07 0.14 

RC02 0.35 0.32 0.26 0.29 0.39 0.27 0.26 0.30 0.26 0.28 

RC03 0.34 0.24 0.18 0.28 0.27 0.27 0.24 0.24 0.28 0.22 

RC04 0.39 0.33 0.30 0.33 0.43 0.39 0.35 0.37 0.37 0.38 

RC05 0.41 0.32 0.31 0.39 0.44 0.42 0.37 0.37 0.39 0.38 

RC06 0.43 0.38 0.35 0.42 0.40 0.38 0.36 0.38 0.41 0.38 

RC07 0.45 0.35 0.34 0.40 0.51 0.42 0.44 0.45 0.44 0.45 

RSOl 0.30 0.32 ~36 ' 0.38 0.44 0.34 0.40 0.35 0.33 0.32 

RC08 0.36 0.40 0.32 0.40 0.37 0.36 0.32 0.37 0.37 0.39 

RC09 0.39 0.41 0.39 0.41 0.46 0.43 0.47 0.48 0.49 0^2 

RCIO 0.41 0.39 0.45 0.42 0.48 0.43 0.44 0.46 0.48 0.49 

RCll 0.37 0.39 0.49 0.41 0.48 0.42 0.47 0^0 0.53 0.50 

RC12 0.43 0.41 0.48 0.47 0,52 0.51 052 0.56 0.58 0.63 

RS02 0.16 0.19 0.29 0.23 0.35 0.19 0.31 0.31 0.28 0.33 

RC13 0.32 0.37 0.47 0.45 0.50 0.44 0.48 0^2 0^4 0.58 

RC14 0.32 0.41 0.41 0.35 0.44 0.40 0.43 0.51 0.54 0.51 

RC15 0.29 0.39 0.43 0.42 0.47 0.41 0.43 0.46 0.51 0.53 

RS03 0.20 0.25 0.36 0.25 0.40 0.28 0.37 0.38 0.36 0.41 

SCOl 0.32 0.30 0.24 0.30 0.28 0.23 0.15 0.24 0.23 0.25 

SC02 0.40 0.28 0.27 0.27 0.27 0.25 0.22 0.24 0.24 0.23 

SC03 0.39 0.34 0.33 0.36 0.30 0.28 0.21 0.22 0.24 0.20 

SC04 0 48 0.46 0.34 0.46 0.38 0.38 0.31 0.41 0.39 0.40 

SC05 0.51 0.36 0.36 0.43 0.44 0.44 0.36 0.39 0.37 0.37 

SC06 0.52 0 43 0.35 0.43 0.45 0.40 0.35 0.38 0.44 0.39 

SC07 0.59 0.55 0.48 0^7 0.55 0.56 0.57 0.54 0.54 0.47 

5501 0.64 0i;7 0.56 0.62 0.58 0.55 0J2 0.53 0.52 0.49 

SC08 1.00 0.62 0.58 0.66 0.62 0.57 0.55 0.53 0.54 0.44 

SC09 0.62 1.00 0.66 0.72 0.62 0.60 0.55 0.58 0.55 0.53 

SCIO 0.58 0.66 1.00 0.67 0.68 0.59 0^7 0.61 0.57 0.56 

sen 0.6<> 0.72 0.67 1.00 0.69 0.67 0.61 0.63 0.55 0.59 

SC12 0.62 0.62 0.68 0.69 1.00 0.75 0.66 0.67 0.64 0.63 

5502 0.57 0.60 039 0.67 0.75 1.00 0.61 0-65 0.59 0.61 

SC13 0.55 0.55 0.57 0.61 0.66 0.61 1.00 0.71 0.61 0.62 

SC14 0.53 0.58 0.61 0.63 0.67 0.65 0.71 1.00 0.71 0.70 

SC15 0.54 0.55 0.57 0.55 0.64 0^9 0.61 0.71 1.00 0.72 

5503 0.44 0.53 056 0.59 0.63 0.61 0.62 0.70 0.72 1.00 
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Table H.IO: Arabic Semester GPA Correlations 



SEMl.GPA 

SEM2.GPA 

SEM3.GPA 

SEMl.GPA 


0.81 

0.68 

SEM2.GPA 

0.81 

1.00 

0.83 

SEM3.GPA 

0.68 

0.83 

1.00 


Table H.ll: Arabic Cumulative Skills Semester GPA Correlations 



LCSKl 

LCSK2 

LCSK3 

RCSKl 

RCSK2 

RCSK3 

SCSKl 

SCSK2 

SCSK3 

LCSKl 

1.00 

0.74 

0.64 

0.75 

0.56 

0.54 

0.57 

0.59 

0.54 

LCSK2 

0.74 

1.00 

0.75 

0.67 

0.65 

0.73 

0.49 

0.62 

0.65 

LCSK3 

0.64 

0.75 

1.00 

0.54 

0.62 

0.73 

0.36 

0.51 

0.61 

RCSKl 

0.75 

0.67 

0.54 

1.00 

0.67 

0.60 

0.56 

0.52 

0.49 

RCSK2 

0.56 

0.65 

0.62 

0.67 

1.00 

0.80 

0.38 

0.49 

0.59 

RCSK3 

0.54 

0.73 

0.73 

0.60 

0.80 

1.00 

0.34 

0.50 

0.62 

SCSKl 

0.57 

0.49 

0.36 

0.56 

0.38 

0.34 

1.00 

0.67 

0.57 

SCSK2 

0.59 

0.62 i 

0.51 

0.52 

0.49 

0.50 

0.67 

1.00 

0.77 

SCSK3 1 

0.54 

0.65 

0.61 

0.49 

0.59 

0.62 

0.57 

0.77 

1.00 
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APPENDIX I. PREDICTING ARABIC SUSTAINED STUDENT PERFORMANCE 


Table I.l: Predicting Sustained Performance on Arabic Listening C-Tests 


Model 

RSE* 

EB3I 


Tests with p-value < 0.05 

LISTENING 





(1) LS03 - LC15 + LC14 + LC13 + LS02 + LC12 + LCl 1 
+ LCIO + LC09 + LC08 + LSOl + LC07 + LC06 + LC05 + 
LC04 + LC03 + LC02 + LCOl 

0.630 

215 

0.524 

LCOl, LSOl, LS02, LC14, 

LC15 

(2) LC15 - LC14 + LC13 + LS02 + LC12 + LCl 1 + LCIO 
+ LC09 + LC08 + LSOl + LC07 + LC06 + LC05 + LC04 + 
LC03+LC02 + LC01 

0.584 

250 

0.532 

LC08,LC11,LS02,LC14 

(3) LC14 - LC13 + LS02 + LC12 + LCl 1 + LCIO + LC09 
+ LC08 + LSOl + LC07 + LC06 + LC05 + LC04 + LC03 + 
LC02 + LCOl 

0.581 

252 

0.561 

LC09,LC13 

(4) LCl3 - LS02 + LC12 + LCl 1 + LCIO + LC09 + LC08 
+ LSOl + LC07 + LC06 + LC05 + LC04 + LC03 + LC02 + 
LCOl 

0.455 

255 

0.587 

LC08, LCIO, LCl 1,LC12 

(5) LS02 - LC12 + LCl 1 + LCIO + LC09 + LC08 + LSOl + 
LC07 + LC06 + LC05 + LC04 + LC03 + LC02 + LCOl 

0.541 

257 

0.525 

LSOl, LC09, LCIO, LCl 1, 

LCl 2 

(6) LC12 - LCn + LCIO + LC09 + LC08 + LSOl + LC07 
+ LC06 + LC05 + LC04 + LC03 + LC02 + LCOl 

0.543 

261 

0.437 

LC06, LC07, LC08, LC09, 

LCll 

(7) LCl 1 - LCIO + LC09 + LC08 + LSOl + LC07 + LC06 
+ LC05 + LC04 + LC03 + LC02 + LCOl 

0.545 

264 

0.551 

LSOl, LC08,LC09, LCIO 

(8) LCIO- LC09 + LC08 + LSOl + LC07 + LC06 + LC05 
+ LC04 + LC03 + LC02 + LCOl 

0.541 

267 

0.505 

LC06, LSOl, LC08, LC09 

(9) LC09 - LC08 + LSOl + LC07 + LC06 + LC05 + LC04 
+ LC03+LC02 + LC01 

0.607 

269 

0.469 

LC06, LSOl, LC08 

(10) LC08 - LSOl + LC07 + LC06 + LC05 + LC04 + LC03 
+ LC02+LC01 

0.519 

270 

0.444 

LC05, LC07 

(11) LSOl - LC07 + LC06 + LC05 + LC04 + LC03 + LC02 
+ LC01 

0.811 

281 

0.351 

LC02, LC04, LC07 

(12) LC07 - LC06 + LC05 + LC04 + LC03 + LC02 + LCOl 

0.561 

283 

0.414 

LCOl, LC04, LC05, LC06 

(13) LC06 - LC05 + LC04 + LC03 + LC02 + LCOl 

0.585 

297 

0.527 

LC04, LC05 

(14) LC05 - LC04 + LC03 + LC02 + LCOl 

0.629 

308 

0.450 

LC02, LC03, LC04 

(15) LC04 - LC03 + LC02 + LCOl 

0.655 

317 

0.433 

LC01,LC02,LC03 

(16) LC03 - LC02 + LCOl 

0.670 

326 

0.382 

LCOl, LC02 

(17) LC02 - LCOl 

0.721 

331 

0,295 

LCOl 


*RSE; Residual Standard Error 


*d.o.f.: degrees of freedom 
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Table 1.2: Predicting Sustained Performance on Arabic Reading C-Tests 


Mode! 

RSE 

d.o.f. 


Tests with p-value < 0.05 

READING 





(1) RS03 - RC15 + RC14 + RC13 + RS02 + RCI2 + RCl 1 
+ RCIO + RC09 + RC08 + RSOI + RC07 + RC06 + RC05 + 
RC04 + RC03 + RC02 + RCOl 

0-526 

215 

0.522 

RCOS, RSOI, RCl KRS02, 

RC15 

(2) RC15 - RC14 + RC13 + RS02 + RC12 + RCl 1 + RCIO 
+ RC09 + RC08 + RSOI + RC07 + RC06 + RC05 + RC04 + 
RC03 + RC02 + RCOl 

0.548 

250 

0.537 

RSOI, RCl 1,RC14 

(3)RC14 - RC13 + RS02 + RC12 +RCl 1 + RCIO+ RC09 
+ RC08 + RSOI + RC07 + RC06 + RC05 + RC04 + RC03 + 
RC02 + RC01 

0.5SS 

252 

0.645 

RSOI, RC09, RCIO, RCl2, 
RS02,RCI3 

(4) RC13 - RS02 + RC12 + RCl 1 + RCIO + RC09 + RC08 
+ RSOI + RC07 + RC06 + RC05 + RC04 + RC03 + RC02 + 
RCOl 

0-498 

255 

0.650 

RC02, RCOS, RCIO, RCll, 

RCl2, RS02 

(5) RS02 - RC12 + RCl 1 + RCIO + RC09 + RC08 + RSOI 
+ RC07 + RC06 + RC05 + RC04 + RC03 + RC02 + RCOl 

0.597 

257 

0.282 

RC04, RC06, RSOI 

(6) RC12 - RCl 1 + RCIO + RC09 + RCOS + RSOI + RC07 
+ RC06 + RC05 + RC04 + RC03 + RC02 + RCOl 

0.487 

261 

0.608 

RCOS, RC09, RCIO, RCll 

(7) RCl 1 - RCIO + RC09 + RC08 + RSOI + RC07 + RC06 
+ RC05 + RC04 + RC03 + RC02 + RCOl 

0.482 

264 

0.599 

RS01,RC09, RCIO 

(8) RCIO - RC09 + RC08 + RSOI + RC07 + RC06 + RC05 
+ RC04 + RC03 + RC02 + RCOl 

0.481 

267 

0.553 

RC04, RCOS, RC07, RC08, 

RC09 

(9) RC09 - RC08 + RSOI + RC07 + RC06 + RC05 + RC04 
+ RC03 + RC02 + RC01 

0.681 

269 

0.456 

RC06, RSOI, RCOS 

(10) RC08 ~ RSOI + RC07 + RC06 + RC05 + RC04 + 

RC03 + RC02 + RCOl 

0.467 

270 

0.47 

RC06, RC07, RSOI 

(11) RSOI - RC07 + RC06 + RC05 + RC04 + RC03 + 

RC02 + RCOl 

0.696 

281 

0.474 

RC02, RC03, RC04, RC07 

(12) RC07 - RC06 + RCOS + RC04 + RC03 + RC02 + 

RCOl 

0.584 ! 

28S 

0.536 

RC02, RC05, RC06 

(13) RC06 - RCOS + RC04 + RC03 + RC02 + RCOl 

0.522 

297 

0.549 

RC04, RCOS 

(14) RCOS - RC04 + RC03 + RC02 + RCOl 

0.551 

308 

0.557 

RC02, RC03, RC04 

(15) RC04 - RCOS + RC02 + RCOl 

0.641 

317 

0.479 

RCOl, RC02, RC03 

(16) RCOS-RC02 +RCOl 

0.75S 

326 

0.437 

RC01,RC02 

(17)RC02-RC01 

0.722 

331 

0.385 

RCOl 
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Table L3: Predicting Sustained Performance on Arabic Speaking C-Tests 


Model 

RSE 

d.o.f. 

R- 


SPEAKING 





(l)SSO3-SC15 + SC14 + SC13 + SS02 + SC12 + SCll + 

SCIO + SC09 + SC08 + SSOl + SC07 + SC06 + SC05 + SC04 + 
SC03 + SC02 + SCOl 

0353 

215 

0.645 

SC08,SC13,SC14, SCI5 

(2) SC15 - SC14 + SC13 + SS02 + SC12 + SCI 1 + SCIO + 

SC09 + SC08 + SSOl + SC07 + SC06 + SC05 + SC04 + SC03 + 
SC02 + SCOl 

0366 

250 

0.582 

SC11,SC12, SC14 

(3) SC14 - SCO + SS02 + SCO + SCI 1 + SCIO + SC09 + 

SC08 + SSOl + SC07 + SC06 + SC05 + SC04 + SC03 + SC02 + 
SCOl 

0369 

252 

0.616 

SC04, SCIO, SS02, SC13 

(4) SCO - SS02 + SCO + SCI 1 + SCIO + SC09 + SC08 + 

SSOl + SC07 + SC06 + SC05 + SC04 + SC03 + SC02 + SCOl 

0383 

255 

0.560 

SC07, SC12 

(5) SS02 - SCO + SCI 1 + SCIO + SC09 + SC08 + SSOl + 

SC07 + SC06 + SC05 + SC04 + SC03 + SC02 + SCOl 

0337 

257 

0.626 

SC01,SC05, SC11,SC12 

(6) SCO - SCI 1 + SCIO + SC09 + SC08 + SSOl + SC07 + 

SC06 + SC05 + SC04 + SC03 + SC02 + SCOl 

0360 

261 

0.610 

SCIO, sen 

(7) SCI 1 - SCIO + SC09 + SC08 + SSOl + SC07 + SC06 + 

SC05 + SC04 + SC03 + SC02 + SCOl 

0339 

264 

0.637 

SC08, SC09, SCIO 

(8) SCIO - SC09 + SC08 + SSOl + SC07 + SC06 + SC05 + 

SC04 + SC03 + SC02 + SCOl 

0.410 

267 

0.531 

SCOl, SC08, SC09 

(9) SC09 - SC08 + SSOl + SC07 + SC06 + SC05 + SC04 + 

SC03 + SC02 + SCOl 

0.399 

269 

0.488 

SC04, SC07, SS01,SC08 

(10) SC08 - SSOl + SC07 + SC06 + SC05 + SC04 + SC03 + 

SC02 + SCOl 

0.412 

270 

0.489 

SC06, SC07, SSOl 

(11) SSOl - SC07 + SC06 + SC05 + SC04 + SC03 + SC02 + 

SCOl 

0.373 

281 

0.583 

SCOl, SC05, SC07 

(12) SC07 - SC06 + SC05 + SC04 + SC03 + SC02 + SCO 1 

0.431 

283 

0.441 

SC04, SC05, SC06 

(13) SC06 - SC05 + SC04 + SC03 + SC02 + SCOl 

0.470 

297 

0.450 

SC03, SC04, SC05 

(14) SC05 ~ SC04 + SC03 + SC02 + SCOl 

0.497 

308 

0.513 

SC02, SC04 

(15) SC04 - SC03 + SC02 + SCOl 

0.492 

317 

0.525 

SCOl, SC02, SC03 

(16) SC03 - SC02 + SCOl 

0.519 

326 

0.481 

SCOl, SC02 

(17) SC02 ~ SCOl 

0.506 

331 

0.467 

SCOl 


Table 1.4: Predicting Sustained Performance with Arabic Semester GPAs 


Model 

RSE 

d.o.f. 

r" 

^msmssBBsm 

(1) SEM3.GPA - SEMl.GPA + SEM2.GPA 

0.286 

310 

0.718 

SEM2.GPA 

(2) SEM2.GPA - SEMl.GPA 

0310 

321 

0.640 

SEMl.GPA 
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Table 1.5: Predicting Sustained Performance with Arabic Cumulative Skills Semester GPAs 


Model 

RSE 

d.o.f. 

r' 

GPAs with p-value < 0.05 

LISTENING 





(1 ) LCSK3.GPA ~ LCskl .GPA + LCSK2.GPA 

0.462 

230 

0.569 

LCSKI.GPA, LCSK2.GPA 

(2) LCSK2.GPA - LCSKI.GPA 

0.429 

269 

0.534 

LCSKI.GPA 

READING 





(3) RCSK3.GPA - RCSKl.GPA + RCSK2GPA 

0.382 

230 

0.647 

RCSKl.GPA. RCSK2.GPA 

(4) RCSK2.GPA ~ RCSKl.GPA 

0.417 

269 

0.449 

RCSKl.GPA 

SPEAKING 





(5) SCSK3.GPA - SCSKl.GPA + SCSK2.GPA 

0.318 

230 

0.603 

SCSKl.GPA 

(6) SCSK2.GPA ~ SCSKl.GPA 

0.347 

269 

0.466 

SCSKl.GPA 
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APPENDIX J. ARABIC SEMESTER GPA CROSSTABULATIONS 


The crosstabulations of the semester GPAs are presented in the same manner as the Persian 
semester GPA crosstabulations. 


Table J.l: Arabic DLPT and First Semester GPA Crosstabnlations 


First Semester 

GPA Intervals 

Category 


0 (less than 2/2/1) 

1 (2/2/1 or 2/2/1+) 

2 (2/2/2 or better) 

mm 

n 

18 

8 

5 

% 

.581 

.258 

.161 


n 

34 

46 

13 

% 

.366 

.495 

.140 

2.5-2.9 

n 

22 

37 

32 

% 

.242 

.407 

.352 

2.9-3.2 

n 

5 

15 

21 

% 

.122 

.366 

.512 

1 

In 

h 

1 

10 

17 

% 

.036 

.357 

.607 


n 

0 

1 

17 

% 


.056 

.944 

3.7-4.0 

n 

0 

0 

9 

% 



1.00 

1 Column Totals 

80 

117 

114 


4 .0 - 

—■ r 


3.5 H 



-I-1-T 

0 1 2 
CATEGORY 


Figure 19: Arabic Boxplot of Category versus First Semester GPA 
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Table J.2: Arabic DLPT and Second Semester GPA Crosstabulations 


Second Semester 
GPA Intervals 

Category 


0 (less than 2/2/1) 

1 (2/2/1 or 2/2/1+) 

2 (2/2/2 or better) 

1 .0-2.0 

n 

16 

4 

3 

% 

.696 

.174 

.130 

2.0-2.5 

n 

36 

39 

10 

% 

.424 

.459 

.118 

2.5-2.9 

n 

21 

47 

26 

% 

.223 

.500 

.277 

2.9-3.2 

n 

8 

25 

29 

% 

.129 

,403 

.468 

3.2-3.5 

n 

0 

4 

19 

% 


.174 

.826 

3.5-3.7 

n 

0 

2 

17 

% 


.105 

.895 

o 

1 

n 

0 

0 

12 

% 



1.00 

1 Column Totals 

81 

121 

116 


3.6 

3.1 

2 .6 

2.1 

1 .6 



CATEGORY 


Figure 20: Arabic Boxplot of Category versus Second Semester GPA 
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Table J3: Arabic DLPT and Third Semester GPA Crosstabulations 


Third Semester 

GPA Intervals 

Category 


0 (less than 2/2/1) 

1 (2/2/1 or 2/2/1+) 

2 (2/2/2 or better) 

1 .0-2.0 

n 

8 

2 

0 

% 

.800 

.200 


2.0-2.5 

n 

40 

18 

10 

% 

.588 

.265 

.147 

2.5-2.9 

n 

20 

43 

18 

% 

.247 

.531 

.222 

2.9-3.2 

n 

9 

40 

22 

% 

.127 

.563 

.310 

1 

In 

n 

4 

12 

27 

% \ 

.093 

.279 

.628 

3.5-3.7 

n 

0 ' 

5 

13 

% 


.278 

.722 

3.7-4.0 

n 

0 

1 

27 

% 


.036 

.964 

1 Column Totals 

81 

121 

117 



CATEGORY 


Figure 21: Arabic Boxplot of Category versus Third Semester GPA 
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APPENDIX K. ARABIC CUMULATIVE SKILLS SEMESTER GPA 
CROSSTABULATIONS 

The crosstabulations show cumulative skills semester GPA intervals, one GPA per skill 
at a time, that correspond to attaining minimum DLPT scores. Appendix J details the 
crosstabulations of cumulative skills semester GPAs by skill to achieving at least a level 2 in that 
particular skill and to achieving either a level 1 or 1+ in that particular skill. The categories for 
each skill are defined as follows: 2 - at least a level 2,1 - either a level 1 or 1+, 0 - not achieving 
at least a 1, 


Table K .1: Arabic DLPT.L and Listening Cumulative Skills First Semester GPA Crosstabulations 


Listening First Semester 
GPA Intervals 

Category 


0 (less than 1) 

1 (1 or 1+) 

2 (2 or better) 

1 .0--2.0 

n 

0 

24 

31 

% 


.436 

.564 

2.0-2.5 

n 

0 

29 

52 

% ■ 


.358 

.642 

2.5-2.9 

n 

0 

8 

41 

% 


.163 

.837 

2.9-3.2 

n 

0 

6 

32 

% 


.158 

.842 

3.2-3.5 

n 

0 

0 

19 

% 



1.00 

3.5-3.7 

n 

0 

0 

17 

% 



1.00 

3.7-4.0 

n 

0 

0 

10 

% 



1.00 

1 Column Totals 

0 

67 

202 



Figure 22; Boxplot of Listening Category versus First Semester Cumulative Skills GPA 
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Table K.2: Arabic DLPT.L and Listening Cumulative Skills Second Semester GPA Crosstabulations 


Listening Second Semester 
GPA Intervals 

Category 


0 (less than 1) 

1 (1 or 1+) 

2 (2 or better) 

LO - 2.0 

n 

0 

27 

14 

% 


.659 

,341 

2.0 - 2.5 

n 

0 

23 

50 

% 


.315 

.685 

2.5 - 2.9 

n 

0 

14 

40 

% 


.259 

.741 

2.9 ~ 3.2 

n 

0 

3 

39 

% 


.071 

.929 

3.2 - 3.5 

n 

0 

1 

29 

% 


.033 

.967 

UHHfl 

n 

0 

0 

22 

% 



1.00 

3.7 - 4.0 

n 

0 

0 

10 

% 



1.00 

1 Column Totals 

0 

68 

204 


4.0 - 

3.5 - 

3.0 - 

2.5 - 

2.0 - 

1.5 - 

1.0 - 

1 2 
LC AT 

Figure 23: Boxplot of Listening Category versus Second Semester Cumulative Skills GPA 
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Table K.3; Arabic DLPT.L and Listening Cumulative Skills Third Semester GPA Crosstabulations 



Figure 24: Boxplot of Listening Category versus Third Semester Cumulative Skills GPA 
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RCSK1.GPA 


Table K.4; Arabic DLPT.R and Reading Cumulative Skills First Semester GPA Crosstabulations 


Reading First Semester 
GPA Intervals 

Category 


0 (less than 1) 

1 (1 or 1+) 

2 (2 or better) 

1.0-2.0 

n 

0 

2 

24 

% 


.077 

.923 

2.0-2.5 

n 

0 

1 

62 

% 


.016 

.984 

2.5-2.9 

n 

0 

4 

55 

% 


.068 

.932 

2.9-3.2 

n 

0 

1 

36 

% 


.027 

.973 

3.2-35 

n 

0 

0 

42 

% 



1.00 

35 - 3.7 

n 

0 

0 

21 

% 



1.00 

3.7-4.0 

n 

0 

0 

21 

% 



1.00 

1 Column Totals 

0 

8 

261 


4.0 

3.5 

3.0 

2.5 

2.0 

1 .5 

1.0 



RC AT 


Figure 25: Boxplot of Reading Category versus First Semester Cumulative Skills GPA 
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RCSK2.GPA 


Table K.5; Arabic DLPT.R and Reading Cumulative Skills Second Semester GPA Crosstabulations 


Reading Second Semester 
GPA Intervals 

Category 


0 (less than 1) 

imBHi 

2 (2 or better) 

1.0-2.0 

n 

0 

1 

16 

% 


.059 

.941 

2.0-25 

n 

0 

3 

37 

% 


.075 

.925 

2.5-2.9 

n 

0 

3 

68 

% 


.042 

.958 

2.9-3.2 

n 

0 

1 

57 

% 


.017 

.983 

3.2-35 

n 

0 

0 

41 

% 



1.00 


n 

0 

0 

27 

% 



1.00 


n 

0 

0 

18 

% 



1.00 

1 Column Totals' 

0 

8 

264 



1 .0 “ 

-1-—-T 

1 2 
RCAT 


Figure 26: Boxplot of Reading Category versus Second Semester Cumulative Skills GPA 
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RCSK3.G PA 


Table K.6: Arabic DLPT.R and Reading Cumulative Skills Third Semester GPA Crosstabulations 


Reading Third Semester 
GPA Intervals 

Category 


0 (less than 1) 

1 (1 or 1+) 

2 (2 or better) 

mm 

n 

0 

3 

13 

% 


.188 

.812 

2.0-2^ 

n 

0 

4 

24 

% 


.143 

.857 

2.5 - 2.9 

n 

0 

0 

51 

% 



1.00 

2.9 - 3.2 

n 

0 

0 

40 

% 



1.00 

3.2-3.5 

n 

0 

0 

35 

% 



1.00 

3.5-3.7 

n 

0 

0 

20 

% 



1.00 

3.7-4.0 

n 

0 

0 

45 

% 



1.00 

1 Column Totals 

0 

7 

228 



1 2 
RC AT 


Figure 27: Boxplot of Reading Category versus Third Semester Cumulative Skills GPA 


no 
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Table K.7: Arabic DLPT.S and Speaking Cumulative Skills First Semester GPA Crosstabulations 


Speaking First Semester 
GPA Intervals 

Category 


0 (less than 1) 

1 (1 or 1+) 

2 (2 or better) 

1.0-2.0 

n 

1 

10 

1 

% 

,083 

.833 

.083 

2.0-2.5 

n 

0 

44 

16 

% 


.733 

.267 

2.5-2.9 

n 

0 

61 

20 

% 


.753 

.247 

2.9-3.2 

n 

0 

37 

23 

% 


.617 

.383 

3.2-3.5 

n 

0 

18 

22 

% 


.450 

.550 

3.5-3.7 

n 

0 

2 

9 

% 


.182 

.818 

3.7-4.0 

n 

0 

0 

5 

% 



1.00 

1 Column Totals 

1 

172 

96 


4 .0 H 


3.5 H 



Figure 28: Boxplot of Speaking Category versus First Semester Cumulative Skills GPA 
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Table K.8: Arabic DLPT.S and Speaking Cumulative Skills Second Semester GPA Crosstabulations 



0 1 2 
SCAT 


Figure 29: Boxplot of Speaking Category versus Second Semester Cumulative Skills GPA 
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Table K.9: Arabic DLPT.S and Speaking Cumulative Skills Third Semester GPA Crosstabulations 




0 1 2 
SCAT 


Figure 30: Boxplot of Speaking Category versus Third Semester Cumulative Skills GPA 
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APPENDIX L. IDENTIFYING POTENTIAL DECISION POINTS FOR ARABIC 
ATTRITION BASED ON MAJOR PROGRAM TESTS 


Table L.l: Identifying Potential Decision Points for Arabic Attrition in Listening 


Model 

RSE 

d.o.f. 

■ 

Change in 

LISTENING 





DLPT.L - LC-TESTl 


268 

0.032 

0.032 

DLPT.L - LC-TESTl + LC-TEST2 

5.66 

267 

0.107 

0.075 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 

5.52 

266 

0.155 

0.048 

DLPT.L ~ LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 

5.37 

264 

0.206 

0.051 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 

5.19 

263 

0.261 

0.055 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 

5.18 

262 

0.265 

0.004 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 

5.12 

261 

0.287 

0.022 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl 

4.88 

260 

0.354 

0.067 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 

4.72 

259 

0.400 

0.046 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 

, 4.69 

258 

0.407 

0.007 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 + LC-TESTl 0 

4.62 

257 

0.426 

0.019 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 + LC-TESTIO + LC-TESTl 1 

4.46 

256 

0.468 

0.042 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 + LC-TESTlO + LC-TESTl 1 + 
LC-TEST12 

4.44 

255 

0.475 

0.007 

DLPT.L - LC-TEST1 + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 + LC-TESTIO + LC-TESTl 1 + 
LC-TEST12 + LS02 

4.42 

253 

0.484 

0.009 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 + LC-TESTIO + LC-TESTl 1 + 
LC-TEST12 + LS02 + LC-TEST13 

4.40 

252 

0-490 

0.006 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 + LC-TESTIO + LC-TESTl 1 + 
LC-TEST12 + LS02 + LC-TEST13 + LC-TEST14 

4.37 

250 

0.501 

0.011 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 + LC-TESTIO + LC-TESTl 1 + 
LC-TEST12 + LS02 + LC-TEST13 + LC-TEST14 + LC- 
TEST15 

4.31 

249 

0.515 

0.014 

DLPT.L - LC-TESTl + LC-TEST2 + LC-TEST3 + LC- 
TEST4 + LC-TEST5 + LC-TEST6 + LC-TEST7 + LSOl + 
LC-TEST8 + LC-TEST9 + LC-TESTIO + LC-TESTl 1 + 
LC-TEST12 + LS02 + LC-TEST13 + LC-TEST14 + LC- 
TEST15 + LS03 

4.47 

214 

0.503 

-0.012 

















































































Table L.2: Identifying Potential Decision Points for Arabic Attrition in Reading 


Model 

RSE 



Change in 

r" 

READING 





DLPT.R - RC-TESTl 

4.14 

268 

0.029 

0.029 

DLPT.R - RC-TESTl + RC-TEST2 

3.95 

267 

0.121 

0.092 

DLPT.R - RC-TESTl + RC-TEST2 -i- RC-TEST3 

3.93 

266 

0.133 

0.012 

DLPT.R - RC-TESTl + RC-TEST2 -h"RC-TEST3 + 
RC-TEST4 

3.78 

264 

0.199 

0.066 

DLPT.R - RC-TESTl + RC-TEST2 + RC-TEST3 + 
RC-TEST4 -1- RC-TEST5 

3.74 

263 

0.221 

0.022 

DLPT.R - RC-TESTl RC-TEST2 + RC-TEST3 + 
RC-TEST4 + RC-TEST5 + RC-TEST6 

3.62 

262 

0.273 

0.052 

DLPT.R - RC-TESTl RC-TEST2 -i- RC-TEST3 + 
RC-TEST4 -h RC-TEST5 -^ RC-TEST6 + RC-TEST7 

3.58 

261 

0.293 

0.020 

DLPT.R - RC-TESTl + RC-TEST2 + RC-TEST3 + 
RC-TEST4 -h RC-TEST5 + RC-TEST6 + RC-TEST7 -h 
RSOl 

3.49 

260 

0.331 

0.038 

DLPT.R - RC-TESTl -i- RC-TEST2 + RC-TEST3 
RC-TEST4 -^ RC-TEST5 + RC-TEST6 -t- RC-TEST7 + 
RSOl ■^RC-TEST8 

3.38 

259 

0.375 

0.044 

DLPT.R - RC-TESTl + RC-TEST2 -i- RC-TEST3 + 
RC-TEST4 + RC-TEST5 + RC-TEST6 + RC-TEST7 -i- 
RSOl + RC-TEST8 + RC-TEST9 

3.30 

258 

0.403 

0.028 

DLPT.R - RC-TESTl + RC-TEST2 + RC-TEST3 + 
RC-TEST4 + RC-TEST5 + RC-TEST6 + RC-TEST7 -l- 
RSOl + RC-TEST8 -f RC-TEST9 -i- RC-TESTIO 

3.25 

257 

0.426 

0.023 

DLPT.R - RC-TESTl -h RC-TEST2 + RC-TEST3 + 
RC-TEST4 + RC-TEST5 + RC-TEST6 -i- RC-TEST7 + 
RSOl + RC-TEST8 -i- RC-TEST9 + RC-TESTlO + RC- 
TESTl I 

3.18 

256 

0.453 

0.027 

DLPT.R - RC-TESTl + RC-TEST2 + RC-TEST3 + 
RC-TEST4 + RC-TEST5 -t- RC-TEST6 -i- RC-TEST7 
RSOl -I- RC-TEST8 + RC-TEST9 -i- RC-TESTIO + RC- 
TESTl 1 + RC-TESTl 2 

3.11 

255 

0.477 

0.024 

DLPT.R - RC-TESTl + RC-TEST2 + RC-TEST3 + 
RC-TEST4 + RC-TEST5 -i- RC-TEST6 + RC-TEST7 + 
RSOl + RC-TEST8 + RC-TEST9 + RC-TESTIO + RC- 
TESTl 1 + RC-TESTl 2 RS02 

3.12 

253 

0.479 

0.002 

DLPT.R - RC-TESTl -i- RC-TEST2 RC-TEST3 -i- 
RC-TEST4 RC-TEST5 + RC-TEST6 + RC-TEST7 + 
RSOl -t- RC-TEST8 + RC-TEST9 + RC-TESTIO -i- RC- 
TESTl 1 + RC-TEST12 + RS02 + RC-TEST13 

3.11 

252 

0.485 

0.006 

DLPT.R - RC-TESTl -i- RC-TEST2 + RC-TEST3 + 
RC-TEST4 + RC-TEST5 -i- RC-TEST6 + RC-TEST7 + 
RSOl + RC-TEST8 + RC-TEST9 + RC-TESTIO + RC- 
TESTl 1 + RC-TEST12 RS02 + RC-TEST13 + RC- 
TEST14 

3.07 

250 

0.501 

0.016 

DLPT.R - RC-TESTl + RC-TEST2 + RC-TEST3 -i- 
RC-TEST4 + RC-TEST5 -i- RC-TEST6 + RC-TEST7 + 
RSOl + RC-TEST8 -i- RC-TEST9 RC-TESTIO + RC- 
TESTl 1 + RC-TESTl2 -H RS02 RC-TESTl3 + RC- 
TESTl 4-i-RC-TESTl 5 

2.98 

249 

0.532 

0.031 

DLPT.R - RC-TESTl + RC-TEST2 + RC-TEST3 + 
RC-TEST4 + RC-TEST5 + RC-TEST6 + RC-TEST7 -k 
RSO l + RC-TEST8 -h RC-TEST9 + RC-TESTIO + RC- 
TESTl 1 -h RC-TEST12 + RS02 + RC-TEST13 + RC- 
TESTl 4 + RC-TESTl 5 + RS03 

2,89 

214 

0.525 

-0.007 







































































Table L.3: Identifying Potential Decision Points for Arabic Attrition in Speaking 


Model RSE d.o.f. R Change in 

R' 


SPEAKING 


■nil 

■■ll 


DLPT.S ~ SC-TESTl 

3.87 

268 

0.040 

0.040 

DLPT.S ~ SC-TESTl + SC-TEST2 

3.86 

267 

0.049 

0.009 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 

3.87 

266 

0.049 

0 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 

3.81 

264 

0.080 

0.031 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 -i- 
SC-TEST4 + SC-TEST5 

3.80 

263 

0.092 

0.012 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 

3.77 

262 

0.107 

0.015 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 -t- SC-TEST7 

3.73 

261 

0.133 

0.026 

DLPT.S ~ SC-TESTl + SC-TEST2 + SC-TEST3 -i- 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl 

3.63 

260 

0.180 

: 0.047 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 -h SC-TEST7 + 
SSOl + SC-TEST8 

3.62 

259 

0.185 

0.005 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 -i- 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl + SC-TEST8 + SC-TEST9 

3.59 

258 

0.218 

0.033 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl + SC-TEST8 + SC-TEST9 + SC-TESTIO 

3.53 

257 

0.232 

0.014 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl + SC-TEST8 + SC-TEST9 + SC-TESTlO -i- SC- 
TESTl 1 

3.53 

256 

0.236 

0.004 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl + SC-TEST8 + SC-TEST9 + SC-TESTIO -i- SC- 
TESTl 1 + SC-TEST12 

3-49 

255 

0.257 

0.021 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl + SC-TEST8 + SC-TEST9 + SC-TESTIO + SC- 
TESTl 1 + SC-TEST12 + SS02 

3.41 

253 

0.296 

0.039 

DLPT.S - SC-TESTl + SC-TEST2 -i- SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 -i- SC-TEST7 + 
SSOl + SC-TEST8 + SC-TEST9 + SC-TESTIO + SC- 
TESTl 1 ■¥ SC-TEST12 -I- SS02 + SC-TEST13 

3.41 

252 

0.297 

0.001 

DLPT.S ~ SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl + SC-TEST8 4- SC-TEST9 + SC-TESTIO + SC- 
TESTl 1 + SC-TEST12 + SS02 + SC-TEST13 + SC- 
TESTl 4 

3.42 

250 

0.298 

0.001 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl + SC-TEST8 + SC-TEST9 + SC-TESTIO + SC- 
TESTl 1 + SC-TEST12 + SS02 + SC-TEST13 + SC- 
TEST14 + SC-TESTl 5 

3.42 

249 

0.301 

0.003 

DLPT.S - SC-TESTl + SC-TEST2 + SC-TEST3 + 
SC-TEST4 + SC-TEST5 + SC-TEST6 + SC-TEST7 + 
SSOl + SC-TEST8 + SC-TEST9 + SC-TESTIO + SC- 
TESTl 1 SC-TEST12 + SS02 + SC-TEST13 -i- SC- 
TEST14 + SC-TEST15 + SS03 

3.30 

214 

0.334 

0.033 
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APPENDIX M. ARABIC S-PLUS LOGISTIC REGRESSION RESULTS 


LOGISTIC REGRESSION SUB MODEL (1) 

Call: glm(formula = Y1 ~ SEM.l + SEM.2 + SEM.3, family = 
binomial, data = arabdlpt, na.action = na.omit, 
control = list(epsilon = 0.001, maxit = 50, 
trace = F)) 

Deviance Residuals: 


Min 

IQ Median 3Q 

Max 

-2.43 

-0.629 0.355 

0.707 

2.26 

Coefficients: 

Value 

Std. Error 

t value 

(Intercept) 

-7.36 

1.16 

-6.35 

SEM.l 

0.154 

0.473 

0.324 

SEM.2 

0.477 

0.686 

0.695 

SEM-3 

2.43 

0.570 

4.25 


(Dispersion Parameter for Binomial family taken to be 1 ) 
Null Deviance: 319.0 on 272 degrees of freedom 
Residual Deviance: 237.9 on 269 degrees of freedom 
Number of Fisher Scoring Iterations: 4 


LOGISTIC REGRESSION SUB MODEL (2) 

Call: glm(formula = Z1 - SEM.l + SEM.2 + SEM.3, family = 
binomial, data = arabdlpt, na.action = na.omit, 
control = list(epsilon = 0.001, maxit = 50, 
trace = F)) 

Deviance Residuals: 

Min IQ Median 3Q Max 

-2.00 -0.910 -0.478 0.924 2.28 


Coefficients: 



Value 

Std. Error 

t value 

(Intercept) 

-7.48 

1.25 

-5.97 

SEM.l 

0.019 

0.519 

0.036 

SEM.2 

2.28 

0.803 

2.84 

SEM.3 

0.211 

0.626 

0.337 


(Dispersion Parameter for Binomial family taken to be 1 ) 
Null Deviance: 274.7 on 198 degrees of freedom 
Residual Deviance: 223.6 on 195 degrees of freedom 
Number of Fisher Scoring Iterations: 3 
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INDEX OF TERMS 


1. attrit: a student is disenrolled or dropped from DLI; a student is disenrolled or dropped from 
one language program and enrolled in another less difficult language. 

2. basic program: an intensive program for beginner linguists designed to take the student up to a 
Level 2 in listening comprehension, reading comprehension, and speaking ability. 

3. course: one of several components of a language program normally made up of a group of 
lessons, units or modules arranged around one or more functional themes within a language 
program. 

4. C’Test: see program test. 

5. department: organization of teaching teams aligned under a language school for management 
purposes. 

6. disenrollment or dropped: students who encounter academic or administrative difficulties 
which cannot be resolved to enable them to continue in their assigned language training programs 
will be disenrolled from DLI. 

7. Final Learning Objectives(FLOs): the skills and knowledge students should possess at the 
end of their language training programs. 

8. ILR descriptions: characterize six base levels of language proficiency (levels 0-5) with 
additional plus level descriptions for levels 0-4. 

9. major program test: see program test. 

10. minimum successful grade: a grade of C- on any single test. 

1 phase test: see program test. 
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\2.proficiency testing: way of assessing how well an examinee performs in a language 
regardless of where or how the language was acquired; test material covered and questions asked 
typically exceed what may have been studied in any training program. 

Xh. program: the entire set of training courses included in an enrollment option, such as Basic, 
Intermediate, Advanced, etc. 

14. program test: a standardized test developed by the language department given to all students; 
sometimes referred to as a unit, C-Test, or phase test. 

15. recycle: students who encounter academic or administrative difficulties may be considered 
for recycle to another class within the same language. Students will be recycled to a point in the 
program no later than when they first experienced academic difficulty. 

16. school: seven schools carry out all foreign language instruction and training; a school is 
composed of departments, in which instruction of individual foreign languages takes place. 

17. standardized test: a test consistently given to all students within the same class or language 
program within a predetermined testing timeframe; does not refer to statistical evaluation. 

18. teaching team: group of language teachers assigned to train a specific group of students. 

19. test: assessment of a student, created at the department. School, or Institute level and given 
during a course or program of instruction; may be in a variety of formats such as constructed- 
response, fill-in-the blank, multiple-choice, etc. 
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